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(57) Abstract 

A system is disclosed that facilitates web-based information retrieval and display System. A wireless phone Or similar hand-held 
wireless device with Internet Protocol capability is combined with other peripherals to provide a portable portal into the Internet, The 
wireless device prompts a user to input information of interest to the user. This information is transmitted a query to a service routine 
(running on a Web server). The service routine then queries the Web lo find price, shipping and availability in forma Hon from various Web 
suppliers. This information is then available for use by nutrition and health monitoring systems to support an ongoing exercise program. 
The system provides tools for dynamic configuration of a mobile communication network that axe useful in a mobile environment. 
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A SYSTEM, METHOD AND ARTICLE OF MANUFACTURE FOR 
DYNAMIC CONFIGURATION OF A MOBILE COMMUNICATION NETWORK 

Field Of The Invention 

The present invention relates to agent based systems and more particularly to a mobile 
computing environment that accesses the Internet to obtain product information for a user and 
provides tools for dynamic configuration of a mobile communication network. 



Background of the Invention 

10 Computer assistance in all environments is increasingly necessary as computer technology 

becomes increasingly embedded in society. Mobile computing technology addresses this issue 
by allowing the individual to access computer related information at all times and in all 
environments. 



One of the first major advances in mobile computer technology was the Personal Digital 
Assistant (PDA). A PDA allowed a user to access computer related information, yet fitted in the 
palm of the hand. Utilizing a PDA the user could organize personal affairs, write notes, calculate 
equations, and record contact numbers an address book. In addition, PDAs were usually capable 
of interfacing with a desktop computer, typically through a wire connection. The connection 
allowed the PDA to download information and upload information, with the desktop computer. 
Later developments gave the PDA wireless capabilities. The wireless capabilities allowed the 
PDA to interact with other computers that were not physically connected to the PDA. 



Wireless PDAs could communicate with computers that were connected to the World Wide Web, 
and soon led to PDAs capable of Web browsing. One of the first companies to develop Web 
browsing capabilities for PDAs was Intercom. Intercom's Falcon Mobile Server allowed PDAs 
with Web functions to directly connect to a host computer. Just by installing the software onto 
the host server, PDA terminals were able to access information through the World Wide Web. 

Currently, more integration in mobile computing is desired. Nokia, an Irving Texas company, 
has partially addressed the integration issue by developing the Nokia 9000 wireless voice phone. 

1 
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The Nokia 9000 includes a small keyboard, a specialized Web browser from microbrowser 
vendor Unwired Planet, Inc., and a small VGA monitor. Nokia worked with Ericsson Inc, 
Motorola Inc. and Unwired Planet to establish the Wireless Application Protocal (WAP), a 
standardized browser technology and server format. WAP gave manufacturers a standard way to 
put data capability into wireless phones, and allowed carriers to do more over-the-air 
management, For example, if a carrier wanted a field trial or a new data service, the carrier 
could implement the service on a server, deliver it to a phone through the microbrowser and 
adjust the service if they found the service unsatisfactory. 



Prior Art Figure 1 A is a diagram of prior art mobile computing solutions based on web portal 
networks. In the Prior Art, Lhc user 10 must deal separately with each participant of the network. 
In the Prior Art mobile computing solution, the user 1 0 utilizes' an Internet service provider (ISP) 
12 to gain access to a web portal 14. The web portal 14 accesses third party services 16 which 
provide information directly to the user 10. However, in addition to dealing with the Internet 
15 Service Provider 12, the user 10 must purchase the wireless device from the device manufactures 

or retailers 18. In most cases the user 10 would also have to purchase the browser from the 
browser provider 20. Generally, the user would have to pay the wireless communication cost, 
leading to the user needing to deal with the phone company 22. And finally, any web purchases 
would lead to the user 1 0 needing to deal with the credit card company 24, It is obvious that a 
20 coordinated and packaged service would be an ideal mobile computing solution. Furthermore, a 
coordinated and packaged service which made use of agents would be highly desired. 

Agent based technology has become increasingly important for use with applications designed to 
interact with a user for performing various computer based tasks in foreground and background 
25 modes. Agent software comprises computer programs that are set on behalf of users to perform 
routine, tedious and time-consuming tasks. To be useful to an individual user, an agent must be 
personalized to the individual user's goals, habits and preferences. Thus, there exists a 
substantial requirement for the agent to efficiently and effectively acquire user-specific 
knowledge from the user and utilize it to perform tasks on behalf of the user. 



The concept of agency, or the user of agents, is well established. An agent is a person authorized 

by another person, typically referred to as a principal, to act on behalf of the principal. In this 

manner the principal empowers the agent to perform any of the tasks that the principal is 

2 
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unwilling or unable to perform. For example, an insurance agent may handle all of the insurance 
requirements for a principal, or a talent agent may act on behalf of a performer to arrange concert 
dates. 

5 With the advent of the computer, a new domain for employing agents has arrived. Significant 
advances in the realm of expert systems enable computer programs to act on behalf of computer 
users to perform routine, tedious and other lime-consuming tasks. These computer programs arc 
referred lo as "software agents," 

Moreover, there has been a recent proliferation of computer and communication networks. 
These networks permit a user lo access vast amounts of information and services without, 
essentially, any geographical boundaries. Thus, a software agent has a rich environment to 
perform a large number of tasks on behalf of a user. For example, it is now possible for an agent 
to make an airline reservation, purchase the ticket, and have the lickei delivered directly to a user. 
Similarly, an agent could scan the Internet and obtain information ranging from the latest sports 
or news to a particular graduate thesis in applied physics. Current solutions fail to apply agent 
technology to provide targeted acquisition of information for a user's upcoming events. 

SUMMARY OF THE INVENTION 

A system is disclosed that facilitates web-based information retrieval and display 
system. A wireless phone cr similar hand-held wireless device with Internet Protocol 
capability is combined with other peripherals to provide a portable portal into the 
Internet. The wireless device prompts a user to input information of interest to the 

.us er . This inf o rmat i on is- tran s mitt e d a q uery to a s ervice routine (runnin g-on- a Web 

25 server). The service routine then queries the Web to find price, shipping and 

availability information from various Web suppliers. This information is formatted and 
displayed on the hand-held device's screen. The user mfiy then use the hand-held 
device to place an order interactively. The system provides tools for dynamic configuration 
of a mobile communication network that are useful in a mobile environment. 

30 

DESCRIPTION OF THE DRAWINGS 

3 
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The foregoing and oilier objects, aspects and advantages are better understood from the following 
detailed description of a preferred embodiment of the invention with reference to the drawings, 
in which: 

5 Prior Art Figure 1 A is a diagram of Prior Art mobile computing solutions based on web portal 
networks; 

Figure 1 is a block diagram of a representative hardware environment in accordance with a 
preferred embodiment; 

10 

Figure 2 is a flowchart of the system in accordance with a preferred embodiment; 

Figure 3 is a flowchart of a parsing unit of the system in accordance with a preferred 
embodiment; 

15 

Figure 4 is a flowchart for pattern matching in accordance with a preferred embodiment; 
Figures 5 is a flowchart for a search unit in accordance with a preferred embodiment; 
20 Figure 6 is a flowchart for overall system processing in accordance with a preferred embodiment; 

Figure 7 is a flowchart of topic processing in accordance with a preferred embodiment; 
Figure 8 is a flowchart of meeting record processing in accordance with a preferred embodiment; 

-25—; 

Figure 9 is a block diagram of process (low of a pocket bargain finder in accordance with a 
preferred embodiment; 

Figure 10A and 10B are a block diagram and flowchart depicting the logic associated with 
30 creating a customized content web page in accordance with a preferred embodiment; 

Figure 11 is a flowchart depicting the detailed logic associated with retrieving user-centric 

content in accordance with a preferred embodiment; 

4 
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Figure 12 is a data modeJ of a user profile in accordance with a preferred embodiment; 
Figure 13 is a persona data model in accordance with a preferred embodiment; 

5 

Figure 14 is an intention data model in accordance with a preferred embodiment; 

Figure 15 is a flowchart of the processing for generating an agent's current statistics in 
accordance with a preferred embodiment; 

10 . 

Figure 16 is a flowchart of the logic that determines the personalized product rating for a user in 
accordance with a preferred embodiment; 

Figure 17 is a flowchart of the logic for accessing the centrally stored profile in accordance with 
15 a preferred embodiment; 

Figure 18 is a flowchart of the interaction logic between a user and the integrator for a panicular 
supplier in accordance with a preferred embodiment; 

20 Figure 19 is a flowchart of the agent processing for generating a verbal summary in accordance 

with a preferred embodiment; 

Figure 20 illustrates a display login in accordance with a preferred embodiment; 

25 Figure 21 illustrates a managing daily logistics display "inaccordance with a preferred 

embodiment; 

Figure 22 illustrates a user main display in accordance with a preferred embodiment; 

30 Figure 23 illuslniles an agent interaction display in accordance with a preferred embodiment; 

Figure 24 is a block diagram of an active knowledge management system in accordance with a 
preferred embodiment; 

5 
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Figure 25 is a block diagram of a back end server in accordance with a preferred embodiment; 

Figure 26 is a flow chart illustrating how the hardware and software of one embodiment of the 
5 present invention operates; 

Figure 27A illustrates a display of the browser mode in accordance with a preferred embodiment; 
and 

10 Figure 27B is an illustration of a Mobile Portal platform in accordance with a preferred 
embodiment. 

DETAILED DESCRIPTION 

A preferred embodiment of a system in accordance with the present invention is preferably 

15 practiced in the context of a personal computer such as an IBM compatible personal computer, 

Apple Macintosh computer or UNIX based workstation. A representative hardware environment 
is depicted in Figure 1, which illustrates a typical hardware configuration of a workstation in 
accordance with a preferred embodiment having a central processing unit 110, such as a 
microprocessor, and a number of other units interconnected via a system bus 1 12. The 

20 workstation shown in Figure 1 includes a Random Access Memory (RAM) 114, Read Only 

Memory (ROM) 116, an I/O adapter 118 for connecting peripheral devices such as disk storage 
units 120 to the bus 1 12, a user interface adapter 122 for connecting a keyboard 124, a mouse 
126, a speaker 128, a microphone 132, and/or other user interface devices such as a touch screen 
(not shown) to the bus 112, communication adapter 134 for connecting the workstation to a 

25 communication network (e.g., a data processing network) and a display adapter 136 for 

connecting the bus 112 to a display device 138. The workstation typically has resident thereon 
an operating system such as the MicrosoA Windows NT or Windows/95 Operating System (OS), 
the IBM OS/2 operating system, the MAC OS, or UNIX operating system. Those skilled in the 
art will appreciate that the present invention may also be implemented on platforms and 

30 operating systems other than those mentioned. 



6 



PAGE 44/181 ' RCVD AT 1/14/2005 12:09:56 PM [Eastern Standard Time]* SVR:USPTO€FXRM/28 * DNIS:2734041 * CS(D:8013281707 ' DURATION (mm-ss):68-28 



01/14/2005 



10:31 FAX 8013281707 



WORKMAN N YDEGGER 



© 045/181 



WO 00/54206 PCT/IBOO/00385 

* 

A preferred embodiment is written using JAVA, C, and the C++ language and utilizes object 
oriented programming methodology. Object oriented programming (OOP) has become 
increasingly used to develop complex applications. As OOP moves toward the mainstream of 
software design and development, various software solutions require adaptation to make use of 
5 the benefits ofOOP. A need exists for these principles of OOP to be applied to a messaging 

interface of an electronic messaging system such that a set of OOP classes and objects for the 
messaging interface can be provided. 

OOP is a process of developing computer software using objects, including the steps of 
1 0 analyzing the problem, designing the system, and constructing the program. An object is a 

software package that contains both data and a collection of related structures and procedures. 

Since it contains both data and a collection of structures and procedures, it can be visualized as a 

self-sufficient component that does not require other additional structures, procedures or data to 

perform its specific task. OOP, therefore, views a computer program as a collection of largely 
15 autonomous components, called objects, each of which is responsible for a specific task. This 

concept of packaging data, structures, and procedures together in one component or module is 

called encapsulation. 

In general, OOP components are reusable software modules which present an interface that 
20 conforms to an object model and which are accessed at run-time through a component integration 
architecture. A component integration architecture is a set of architecture mechanisms which 
allow software modules in different process spaces to utilize each others capabilities or functions. 
This is generally done by assuming a common component object model on which to build the 
architecture. 

25 " ' " 

It is worthwhile to differentiate between an object and a class of objects at this point. An object 
is a single instance of the class of objects, which is often just called a class. A class of objects 
can be viewed as a blueprint, from which many objects can he formed. 

30 OOP allows the programmer to create an object that is u part of another object. For example, Ihc 

object representing a piston engine is said to have a composition-relationship with the object 
representing a piston. In reality, a piston engine comprises a piston, valves and many other 

7 
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components; the feet that a piston is an element of a piston engine can be logically and 
semantical ly represented in OOP by two objects. 

OOP also allows creation of an object that "depends from*' another object If there are two 
5 objects, one representing a piston engine and the other representing a piston engine wherein the 
piston is made of ceramic, then the relationship between the two objects is not that of 
composition. A ceramic piston engine does not make up a piston engine, Rather it is merely one 
kind of piston engine that has one more limitation than the piston engine; its piston is made of 
ceramic. In this case, the object representing the ceramic piston engine is called a derived object, 
10 and it inherits all of the aspects of the object representing the piston engine and adds further 

limitation or detail to it The object representing the ceramic piston engine "depends from" the 
object representing the piston engine. The relationship between these objects is called 
inheritance. 

15 When the object or class representing the ceramic piston engine inherits all of ihc aspects of the 
objects representing the piston engine, it inherits the thermal characteristics of a standard piston 
defined in the piston engine class. However, the ceramic piston engine object overrides these 
ceramic sped fic thermal characteristics, which are typically different From those associated with 
a metal piston. It skips over the original and uses new functions related to ceramic pistons. 
20 Different kinds of piston engines have different characteristics, but may have the same 

underlying functions associated with it (e.g., how many pistons in the engine, ignition sequences, 
lubrication, etc.). To access each of ihesc functions in any pisLon engine object, a programmer 
would call the same functions with the same names, but each type of pision engine may have 
different/overriding implementations of functions behind the same name. This ability to hide 

25 different im p lementations uf a function behind the same nam e Tsc alled polymorphism and it 

greatly simplifies communication among objects. 

With the concepts of composition-relationship, encapsulation, inheritance and polymorphism, an 
object can represent just about anything in the real world. In fact, our logical perception of the 
30 reality is the only limit on determining the kinds of things that can become objects in object- 
oriented software. Some typical categories are as follows: 



8 
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Objects can represent physical objects, such as automobiles in a traffic-flow simulation, 
electrical components in a circuit-design program, countries in an economics model, or 
aircraft in an air-traffic-control system. 

Objects can represent elements of the computer-user environment such as windows, 
menus or graphics objects. 

An object can represent an inventory, such as a personnel file or a table of the latitudes 
and longitudes of cities. 

An object can represent user-defined data types such as lime, angles, and complex 
numbers, or points on the plane. 



With this enormous capability of an object to rcprcscnL just about any logically separable 
matters, OOP allows the software developer to design and implement a computer program that is 
a model of some aspects of reality, whether that reality is a physical entity, a process, a system, 
or a composition of matter. Since the object can represent anything, the software developer can 
15 create an object which can be used as a component in a larger software project in the future. 

If 90% of a new OOP software program consists of proven, existing components made from 
preexisting reusable objects, then only the remaining 10% of the new soAwarc project has to be 
written and tested from scratch. Since 90% already came from an inventory of extensively tested 
20 reusable objects, the potential domain from which an error could originate is 1 0% of the 

program. As ;i result. OOP cn.nblc* sof(w:irc developers to build ohjccis oiii oTolhcr, previously 
built, objects. 

Thi s pr ocess-closely-rese mblc s complex m a c hin er y being built uut uf assemblies and sub- 



25 assemblies. OOP technology, therefore, makes software engineering more like hardware 
engineering in that software is built from existing components, which arc available to the 
developer as objects. All this adds up to an improved quality of the software as well as an 
increased speed of its development. 

30 Programming languages are beginning to fully support the OOP principles, such as 

encapsulation, inheritance, polymorphism, and composition-relationship. With the advent of the 
C++ language, many commercial software developers have embraced OOP. C++ is an OOP 
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language that offers a fast, machine-executable code, Furthermore, C++ is suitable for both 
commercial-application and systems-programming projects, For now, C++ appears to be the 
most popular choice among many OOP programmers, but there is a host of other OOP 
languages, such as Smalltalk, common lisp object system (CLOS), and Eiffel. Additionally, 
5 OOP capabilities are being added to more traditional popular computer programming languages 
such as Pascal, 



The benefits of object classes can be summarized, as follows: 

• Objects and their corresponding classes break down complex programming problems into 
1 0 many smaller, simpler problems. 

Encapsulation enforces data abstraction through ihe organization of data into small, 
independent objects thai can communicate wilh each other. Encapsulation protects the 
data in an object from accidental damage, but allows other objects to interact with that 
data by calling the object's member functions and structures. 
15 " Subclassing and inheritance make it possible to extend and modify objects through 

deriving new kinds of objects from the standard classes available in the system. Thus, 
new capabilities are created without having to start from scratch. 

• Polymorphism and multiple inheritance make h possible for different programmers to 
mix and match characteristics of many different classes and create specialized objects that 

20 can still work with related objects in predictable ways. 

• Class hierarchies and containmcnl hierarchies provide a flexible mechanism for 
modeling real-world objects and the relationships among them. 

• Libraries of reusable classes are useful in many situations, but they also have some 
limitations. For example: 

25 • Complexity. In a complex system, the class hierarchies for related classes can become 
extremely confusing, with many dozens or even hundreds of classes. 

• Flow of control A program written with the aid of class libraries is still responsible for 
the flow of control (i.e., it must control the interactions among all the objects created 
from a particular library). The programmer has to decide which functions to call at what 

30 limes for which kinds of objects. 

• Duplication of effort. Although class libraries allow programmers to use and reuse many 
small pieces of code, each programmer puts those pieces together in a different way. 

10 
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Two different programmers can use the same set of class libraries to write two programs 
thai do exactly the same thing but whose internal structure (i.e., design) may be quite 
different, depending on hundreds of small decisions each programmer makes along the 
way. Inevitably, similar pieces of code end up doing similar things in slightly different 
ways and do not work as well together as they should. 

Class libraries are very flexible. As programs grow more complex, more programmers are 
forced to reinvent basic solutions to basic problems over and over again. A relatively new 
extension of the class library concept is to have a framework of class libraries. This framework 
is more complex and consists of significant collections of collaborating classes that capture both 
the small scale patterns and major mechanisms that implement the common requirements and 
design in a specific application domain. They were first developed to free application 
programmers from the chores involved in displaying menus, windows, dialog boxes, and other 
standard user inLerfacc elements for personal computers. 

Frameworks also represent a change in the way programmers think about the interaction between 
the code they wriic and code written by others. In Lhe early days of procedural programming, the 
programmer called libraries provided by the operating system to perform certain tasks, but 
basically the program executed down Lhe page from start to finish, and the programmer was 
solely responsible for the flow of control. This was appropriate Tor printing om paychecks, 
calculating a mathematical table, or solving other problems with a program that executed in just 
one way. 

The development of graphical user interfaces began to turn this procedural programming 

arrangement inside out* These interfaces allow the user, rather than program logic, to drive the 

program and decide when certain actions should be performed. Today, most personal computer 

software accomplishes this by means of an event loop which monitors the mouse, keyboard, and 

other sources of external events and calls the appropriate parts of the programmer's code 

according to actions that the user performs. The programmer no longer determines the order in 

which events occur. Instead, a program is divided into separate pieces that arc called at 

unpredictable times and in an unpredictable order. By relinquishing control in this way to users, 

the developer creates a program that is much easier to use. Nevertheless, individual pieces of the 

program written by the developer still call libraries provided by the operating system to 

1 1 
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accomplish certain tasks, and the programmer must still determine the flow of control within 
each piece after being called by the event loop. Application code still "sits on top of" the system. 

Even event loop programs require programmers to write a lot of code that should not need to be 
5 written separately for every application. The concept of an application framework carries the 
event loop concept further. Instead of dealing with all the nuts and bolls of constructing basic 
menus, windows, and dialog boxes and then making these things all work together, programmers 
using application frameworks start with working application code and basic user interface 
elements in place. Subsequently, they build from there by replacing some of the generic 
10 capabilities of the framework with the specific capabilities of the intended application. 

Application frameworks reduce the total amount of code that a programmer has to write from 
scratch. However, because the framework is really a generic application that displays windows, 
supports copy and paste, and so on, the programmer can also relinquish control to a greater 
1 5 degree than event loop programs permit. The framework code takes care of almosL all event 
handling and flow of control, and the programmer's code is called only when the framework 
needs it (c_g., to create or manipulate a proprietary data structure). 

A programmer writing a framework program not only relinquishes control to the user (as is also 
20 true for event loop programs), but also relinquishes the detailed flow of control within the 

program to the framework. This approach allows the creation of more complex systems that 
work together in interesting ways, as opposed to isolated programs, having custom code, being 
created over and over again for similar problems. 

_ ~ 25 i nus, as is explained above, a~7ramework basically is~a collectTon of cooperating classes that 

make up a reusable design solution for a given problem domain. It typically includes objects that 
provide default behavior (e.g., for menus and windows), and programmers use it by inheriting 
some of that default behavior and overriding other behavior so that the framework calls 
application code at the appropriate limes. 



30 



There are three main differences between frameworks and class libraries: 



12 



PAGE 50/181 " RCVD AT 1/14/2005 12:09:56 PM [Eastern Standard Time] * SVR:USPTO-EFXRF-1/28 * DNIS:2734041 * CSID:8013281707 * DURATION (mm-ss):68-28 



01/14/2005 10:34 FAX 8013281707 



WORKMAN NYDEGGER 



I2J 051/181 



^° 00/54106 " • • PCT/IBOO/00385 

• Behavior versus protocol. Class libraries are essentially collections of behaviors that you 
can call when you want those individual behaviors in your program. A framework, on 
the other hand, provides not only behavior but also the protocol or set of rules that govern 
the ways in which behaviors can be combined, including rules for what a programmer is 

5 supposed to provide versus what the framework provides. 

• Call versus override. With a class library, the code the programmer instantiates objects 
and calls their member functions. It's possible to instantiate and call objects in the same 
way with a framework (i.e., to treat the framework as a class library), but to take full 
advantage of a framework's reusable design, a programmer typically writes code that 

1 0 overrides and is called by the framework. The framework manages the flow of control 

among its objects. Writing a program involves dividing responsibilities among the 
various pieces of software that arc called by the framework rather than specifying how 
the different pieces should work together. 

Implementation versus design. With class libraries, programmers reuse only 
15 iiiiplcmcnh.il ions, whereas with frameworks, llrcy tcusc design. A framework embodies ' 
the way a family of related programs or pieces of software work- It represents a generic 
design solution that can be adapted to a variety of specific problems in a given domain. 
For example, a single framework can embody the way a user interface works, even 
though two different user interfaces created with the same framework might solve quite 
20 different interface problems. 

Thus, through the development of frameworks for solutions to various problems and 
programming tasks, significant reductions in the design and development effort for software can 
be achieved. A pref erred embodiment of the invention utilizes Hypertext Mark up Lan guage 

25 (HTML) to implement documents on the Internet together with a general-purpose secure 

communication protocol for a transport medium between the client and the Newco- HTTP or 
other protocols could be readily substituted for HTML without undue experimentation. 
Information on these products is available in T. Bcmers-Lec, D. Connoly, "RFC 1866: Hypertext 
Markup Language - 2.0" (Nov. 1995); and R. Fielding, H, Frystyk, T. Bemers-Lee, J. Gettys and 

30 J.C. Mogul. "Hypertext Transfer Protocol -- HTTP/1 . 1 : HTTP Working Croup Internet Draft" 
(May 2, 1996). HTML is a simple data format used to create hypertext documents that are 
portable from one platform to another. HTML documents are SGML documents with generic 

13 
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semantics that are appropriate for representing information from a wide range of domains. 
HTML has been in use by the World-Wide Web global information initiative since 1990, HTML 
is an application of ISO Standard 8879:1986 Information Processing Text and Office Systems; 
Standard Generalized Markup Language (SGML). 

5 

To dale, Web development tools have been limited in tlicir ability to create dynamic Web 
applications which span from client to server and interoperate with existing computing resources, 
Until recently, HTML has been the dominant technology used in development of Web-based 
solutions. Howcver v HTMLhas proven to be inadequate in the folhowing areas: 
1 0 • Poor performance; 

• Restricted user interface capabilities; 

• Can only produce static Web pages; 

• Lack of interoperability with existing applications and data; and 

• Inability lo scale, 

15 

Sun Microsystem's Java language solves many of the client-side problems by: 

• Improving performance on the client side; 

• Enabling the creation of dynamic, real-time Web applications; and 

• Providing the abilily lo create a wide variety of user interface components. 

20 

With Java, developers can create robust User Interface (UI) components. Custom "widgets" (e_g. 

real-time stock tickers, animated icons, etc.) can be created, and client-side performance is 

improved. Unlike HTML, Java supports the notion of client-side validation, offloading 

appropriate processing onto the client for improved performance. Dynamic, real-time Weh pages 

25 can be created. Using the above-mentioned custom UI components, dynamic Web pages can also 

be created. 

Surfs Java language has emerged as an industry-recognized language for "programming the 
Internet." Sun defines Java as: "a simple, object-oriented, distributed, interpreted, robust, 
30 secure, architecture- neutral, portable, high-performance, multithreaded, dynamic, buzzword- 
compliant, general-purpose programming language, Java supports programming for the Internet 
in the form of platform-independent Java applets." Java applets are small, specialized 

14 
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applications that comply with Sun's Java Application Programming Interface (API) allowing 
developers to add "interactive content" to Web documents (e.g, simple animations, page 
adornments, basic games, etc,)* Applets execute within a Java-compatible browser (e.g. 
Netscape Navigator) by copying code from the server to client. From a language standpoint, 
5 Java's core feature set is based on C++. Sun's Java literature states that Java is basically "C++, 
with extensions from Objective C for more dynamic method resolution". 

Another technology that provides similar function to JAVA is provided by Microsoft and ActiveX 
Technologies, to give developers and Web designers wherewithal to build dynamic content for the 

10 Internet and personal computers. ActiveX includes tools for developing animation, 3-D virtual 

reality, video and other multimedia content. The tools use Internet standards, work on multiple 
platforms, and are being supported by over 1 00 companies. The group's building blocks arc called 
ActiveX Controls, small, fast components that enable developers to embed parts of software in 
hypertext markup language (HTML) pages. ActiveX Controls work with a variety of programming 

15 languages including Microsoft Visual C++, Borland Delphi, Microsoft Visual Basic programming 

system and, in the future, Microsoft's development tool for Java, code named "Jakarta/ 1 ActiveX 
Technologies also includes ActiveX Server Framework, allowing developers to create server 
applications. One of ordinary skill in the art readily recognizes thai ActiveX could be substituted 
for JAVA without undue experimentation to practice the invention. 

20 

In accordance with a preferred embodiment, BackgroundFindcr (BF) is implemented as an agent 
responsible for preparing an individual for an upcoming meeting by helping him/her retrieve 
relevant information about the meeting from various sources. BF receives input text in character 
form indicative of the target meeting. The input text is generated in accordance with a preferred 

25 embodiment by a calendar program that includes ihe lime of the meeting. As the time of the 
meeting approaches, the calendar program is queried to obtain the text of the target event and 
that information is utilized as input to the agent. Then, the agent parses the input meeting text to 
extract its various components such as title, body, participants, location, time etc, The system 
also performs pattern matching to identify particular meeting fields in a meeting text. This 

30 information is utilized to query various sources of information on the web and obtain relevant 

stories about the current meeting to send back to the calendaring system. For example, if an 

individual has a meeting with Netscape and Microsoft to talk about their disputes, and would 

obtain this initial information from the calendaring system. It will then parse out the text Lo 

15 
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realize that the companies in the meeting are "Netscape" and "Microsoft" and the lopic is 
"disputes " Then, the system queries the web for relevant information concerning the topic, 
Thus, in accordance with an objective of the invention, the system updates the calendaring 
system and eventually the user with the best information il can gather to prepare the user for the 
target meeting. In accordance with a preferred embodiment, the information is stored in a file 
that is obtained via selection from a link imbedded in the calendar system. 



PROGRAM ORGANIZATION 

A computer program in accordance with a preferred embodiment is organized in five distinct 
modules; BF.Main, BF.Parse, Background Findcr.Error, BF.PattcmMatching and BRScarch. 
There is also a ftrnMain which provides a user interface used only for debugging purposes. The 
executable programs in accordance with a preferred embodiment never execute with the user 
interface and should only return to the calendaring system through Microsoft's Winsock control. 
A preferred embodiment of the system executes in two different modes which can be specified 
under the command line sent to it by the calendaring system. When the system runs in simple 
mode, it executes a keyword query to submit to external search engines. When executed in 
complex mode, the system performs pattern matching before it forms a query to be sent to a 
search engine. 

DATA STRUCTURES 

20 The system in accordance with a preferred embodiment utilizes three user defined structures: 

1 . TMeetingRecord; 

2. TPatternElemcnt; and 

3. TPattemRecord 

The user-defined structure, iMeetingRecord, is used to store all the pertinent information 

25 concerning a single meeting. This info includes uscrlD, an original description of the meeting, 
the extracted list of keywords from the title and body of meeting etc. It is important to note that 
only one meeting record is created per instance of the system in accordance with a preferred 
embodiment. This is because each time the system is spawned to service an upcoming meeting, 
it is assigned a task to retrieve information for only one meeting. Therefore, the meeting record 

30 created corresponds to the current meeting examined. ParseMeeiingText populates this meeting 
record and it is then passed around io provide in formal ion about the meeting to oilier functions. 

16 



10 



15 



PAGE 54/181 * RCVD AT 1/14/2005 12:09:56 PM [Eastern Standard Time] * SVR:USPTO-EFXRF-1/28 * DNIS:2734041 1 CSID:8D 13281 707 ' DURATION (mm-ss):68-28 



01/14/2005 10:36 FAX 8013281707 



WORKMAN NYDEGGER 



© 055/181 



WO 00/54206 PCT/IB0Q/O03S5 

If GoPatternMatch can bind any values to a particular meeting field, the corresponding entries in 
the meeting record is also updated. The structure of tMeetingRecord with each field described 
in parentheses is provided below in accordance with a preferred embodiment. 



10 



15 



AAAAAA 

sUserlD As String 
sTitleOrig As String 

Munin) 

sTitleKW As String 
sBodyKW As String 



Public Type tMeetingRecord 
(user id given by Munin) 

(original non stop listed title we need to keep around to send back lo 

(stoplisted title with only keywords) 
(stoplislcd body with only keywords) 



sCompanyQ As String (companys identified in title or body through pattern matching) 



sTopic() As String 
sPeople() As String 
sWhen() As String 
sWhcrc() As Siring 
sLocation As String 
sTimc As String 



20 



(topics identified in title or body through pattern matching) 
(people identified in title or body through pattern matching) 
(time identified in title or body through pattern matching) 
(location identified in title or body through pattern matching) 
(location as passed in by Munin) 
(time us passed in by Munin) 
sParticipants() As Siring (all participants engaged as passed in by Munin) 
sMcctingText As String (the original meeting text w/o userid) 
End Type 



25 



There are two other structures which arc created lo hold each individual pattern utilized in pattern 
matching. The record lAPattemRccord is an array containing all the components / elements of a 

pattern. Th e type tAPatternEl e mcnt is an a r r a y of stri n gs which repre s e nt an e lement in a 

puUcrn* Because there may be many "substitutes" for each clement, wc need un array ofstrings 
to keep track of what all the substitutes are. The structures of tAPatternElemcnt and 
lAPalternRccord are presented below in accordance with a preferred embodiment. 



Public Type tAPaltemElement 
30 elcmcnlAirayO As String 

End Type 

Public Type tAPattcrnRecord 

17 
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pattemArrayO As tAPatternEleiDCnt 
End Type 

COMMON USER DEFINED CONSTANTS 

Many constants are defined in each declaration section of the program which may need to be 
5 updated periodically as part of the process of maintaining the system in accordance with a 
preferred embodiment The constants are accessible to allow dynamic configuration of the 
system to occur as updates for maintaining the code. 

Included in the following tables are lists of constants from each module which I thought are most 
10 likely to be modified from time to time. However, there are also other constants used in the code 
not included in the following list. It docs not mean that these non-included constants will never 
be changed. It means that they will change much less frequently. 



For the Main Module (BF.Main) : 



CONSTANT 


PRESET VALUE 


USE 


MSG TOMUNIN_TYPE 


6 


Define the message number used 
to identify messages between BF 
and Munin 


IP_ADDRESS_MUNIN 


"10.2.100.48" 


Define the IP address of the 
machine in which Munin and BF 
are running on so they can transfer 
data through UDP. 


-EOP.T MUNIN 





Define the remote pon in which 






we are operating on. 


TIMEOUT_AV 


60 


Define constants for setting time 
out in inct controls 


TIMEOUTJMP 


60 


Define constants for setting time 
out in inct controls 


CMD_SEPARATOR 




Define delimiter to tell which part 
of Munin's command represents 
the beginning of our input meeting 



18 
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CONSTANT 


PRESET VALUE 


USE 






text 


OUTPARAM_SEPARAT 
OR 




Define delimiter for separating out 
different portions of the output 
The separator is for delimiting the 
msg type, the user id, the meeting 
title and the beginning of the 
actual stories retrieved. 



For the Search Module (BF.Scarch): 





CONSTANT 


CURRENT 
VALUE 


USE 




PASTjsTDAYS 


5 


Define number of days you want 
to look back for AltaVista articles. 
Docsn'l really matter now because 
we aren't really doing a news 
search in alia visia. Wc want all 
info. 


CONNECTOR_AVJJRL 


"+AND+" 


Define how to connect keywords. 
Wc want all our keywords in the 
string so for now use AND. If you 
want to do an OR or something, 
just chungc connector. 












CONNECTOR_NP_URL 


"+AND+" 


Define how to connect keywords. 
We want all our keywords in the 
string so for now use AND. Tf you 
want to do an OR or something, 
jusl change connector. 


NUM_NP_STORJES 


3 


Define the number of stories to 
return back to Munin from 
NewsPage. 



19 
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CONSTANT 


CURRENT 
VALUE 


USE 


NUM_AV_STORJES 


3 


Define the number of stories to 
return back Lo Munin from 
AltaVista. 



5 For the Parse Module (BF.Parse): 



CONSTANT 


CURRENT 
VALUE 


USE 


PORTION_S EPARATOR 


11, ,ff 


Define the separator between 
different portions of the meeting 
text sent in by Munin. For example 
in rt 09::Mecl with Chad::about 
life::Chad | Dcnisc ' is the 
separator between different parts 
of Ihc meeting text. 


PARTICIPANTjSEPARATOR 




Define the separator between each 
participant in the participant list 
portion of the original meeting 
text. 

Refer to example above. 



For Pattern Matching Module (BFPattemMatch): There are no constants in this module which 
require frequent updates. 



General Process Flow 

The best way to depict the process flow and the coordination of functions between each other is 
with the five flowcharts illustrated in Figures 2 to 6. Figure 2 depicts the overall process flow in 
accordance with a preferred embodiment. Processing commences at the top of the chart at 

20 
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function block 200 which launches when the program starts. Once the application is started, the 
command line is parsed to remove the appropriate meeting text to initiate the target of the 
background find operation in accordance with a preferred embodiment as shown in function 
block 210. A global stop list is generated after the target is determined os shown in function 
5 block 220. Then, all the patterns that are utilized for matching operations are generated as 

iUusLralcd in function block 230. Then, by tracing through lhc chart, function block 200 invokes 
GoBF 240 which is responsible for logical processing associated with wrapping the correct 
search query information for the particular target search engine. For example, function block 
240 flows to function block 250 and it then calls GoPatternMatch as shown in function block 
10 260. To see the process flow of GoPatternMatch, we swap to the diagram titled "Process Flow 
for BF's Pattern Matching Unit." 



One key thing to notice is that functions depicted at the same level of the chart are called by in 
sequential order from left to right (or lop to bottom) by their common parent function. For 
example, Main 200 calls ProcessCommandLine 210, then CreatcStopLisiist 220, then 
CreatePatlerns 230, then GoBackgroundFinder 240. Figures 3 to 6 detail the logic for the entire 
program, the parsing unit, the pattern matching unit and the search unit respectively. Figure 6 
details the logic determinative of data flow of key information through BackgroundFinder, and 
shows the functions that arc responsible for creating or processing such information. 

DETAILED SEARCH ARCHITECTURE UNDER THE SIMPLE QUERY 

MODE 

SEARCH ALTA VIS T A 

25 (Function block 270 of Figure 2) 

The AUa Vista search engine utilizes the identifies and returns general information about topics 
related to the current meeting as shown in function block 270 of Figure 2. The system in 
accordance with a preferred embodiment lakes all the keywords from llic title portion of the 
original meeting text and constructs an advanced query to send to Aha Vista. The keywords arc 
30 logically combined together in the query. The results are also ranked based on the same set of 
keywords. One of ordinary skill in the an will readily comprehend that a dale restriction or 

21 
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publisher criteria could be facilitated on the articles we want to retrieve, A set of top ranking 
stories are returned to the calendaring system in accordance with a preferred embodiment. 



NEWS PAGE 

5 (Function block 275 of Figure 2) 

The NewsPage search system is responsible for giving us the latest news topics related to a target 
meeting. The system takes all of the keywords from the title portion of the original meeting text 
and constructs a query to send to the NewsPage search engine. Th6 keywords arc logically 
combined together in the query. Only articles published recently arc retrieved- The Ncwspagc 
10 search system provides a date restriction criteria that is sellable by a user according to the user's 
preference. The lop ranking stories arc relumed lo Ihc calendaring system. 



Figure 3 is a user profile data model in accordance with a preferred embodiment. Processing 
commences at function block 300 which is responsible for invoking the program from the main 

15 module. Then, at function block 310, a wrapper function is invoked to prepare for the keyword 

extraction processing in function block 320. After the keywords are extracted, then processing 
flows lo function block 330 to determine if the delimiters are properly positioned. Then, at 
function block 340, the number of words in a particular string is calculated and the delimiters for 
the particular field are and a particular field from Lhc meeting text is retrieved at function block 

20 350. Then, at function block 380, the delimiters of the string are again cheeked to assure they arc 
placed appropriately. Finally, at function block 360, the extraction of each word from the title 
and body of the message is performed a word at a time utilizing the logic in function block 362 
which finds the next closest word delimiter in the input phrase, function block 364 which strips 
unnecessary materials from a word and function block 366 which determines if a word is on the 

25 stop list and returns an error if the word is on the stop list. 



PATTERN MATCHING IN ACCORDANCE WITH A PREFERRED EMBODIMENT 

The limitations associated with a simple searching method include the following: 
30 I . Dec j use it relics on ;i sloplisl of unwanted words in order lo cxlmci from the meeting lex I 

a set of keywords, it is limited by how comprehensive the sloplisl is. Instead of trying to 

22 
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figure out what parts of the meeting text we should throw away, we should focus on what 
parts of the meeting text we want. 

2. A simple search method in accordance with a preferred embodiment only uses the 
keywords from a meeting title to form queries to send to Alta Vista and NewsPage, This 

5 ignores an alternative source of information for the query, the body of the meeting notice. 

We cannot include the keywords from the meeting body to form our queries because this 
often results in queries which are too long and so complex that we often obtain no 
meaningful results. 

3. There is no way for us to tell what each keyword represents. For example, we may 

10 extract "Andy" and "Grove" as two keywords. However, a simplistic search has no way 

knowing that "Andy Grove" is in fact a person's name. Imagine the possibilities if wc 
could somehow intelligently guess that "Andy Grove" is a person's name. We can find 
out if he is an Andersen person and if so what kind of projects he's been on before etc. 
etc. 

15 4. - In summary, by relying solely on a stoplist lo parse out unnecessary words, we suffer 

from "information overload". 



23 
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PATTERN MATCHING OVERCOMES THESE LIMITATIONS IN ACCORDANCE 

WITH A PREFERRED EMBODIMENT 

5 Here's how the pattern matching system can address each of the corresponding issues above in 
accordance with a preferred embodiment. 

1 . By doing pattern matching, wc match up only parts of the meeting text that wc want and 
extract those parts. 

2. By performing pattern matching on Ihc meeting body and extracting only the parts from the 
10 meeting body that we want. Our meeting body will not go to complete waste then. 

3. Pattern matching is based on a set of templates that wc specify, allowing us to identify people 
names, company names etc from a meeting text. 

4. In summary, with pattern matching, we no longer suffer from information overload. Of 
course, the big problem is how well our pattern matching works. If we rely exclusively on 

15 artificial intelligence processing, we do not have a 100% hit rate. We are able to identify 

about 20% of all company names presented to us. 

PATTERNS 



20 A pattern in the context of a preferred embodiment is a template specifying the structure of a 

phrase we are looking for in a meeting text. The patterns supported by a preferred embodiment 
:irc selected because ihcy arc templates of phrases which have a high probability of appearing in 
someone's meeting text. For example, when entering a meeting in a calendar, many would write 
something such as "Meet with Bob Pulton from Stanford University next Tuesday." A common 

25 pattern would then be something like the word l Viih" followed by a person's name (in this 

example it is Bob Dutton) followed by the word "from" and ending with an organization's name 
(in this case, it is Stanford University), 

PATTERN MATCHING TERMINOLOGY 

30 

The common terminology associated with pattern matching is provided below. 

24 
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♦ Patten: a pattern is a template specifying the structure of a phrase we want to bind the 
meeting text to. It contains sub units. 

♦ Element: a pattern can contain many sub-units. These sub units are called elements. For 
example, in the pattern "with SPEOPLES from $COMPANY$", "with" "$PEOPLE$ M "from** 

5 "$COMPANY$ ,? are all elements. 

♦ Placeholder a placeholder is a special kind of element in which we want to bind a value 
lo.Using the above example, "SPEOPLES" is a placeholder. 

♦ Indicator: an* indicator is another kind of element which we want to find in a meeting text but 

no value needs to bind to it. There may be often more than one indicator we are looking For in 

10 a certain pattern. That is why an indicator is not an ^atomic" type. 

♦ Substitute: substitutes are a set of indicators which are all synonyms of each other. Finding 
any one of them in the input is good. 



There arc five fields which are identified for each meeting: 

15 ♦ Company ($COMPANY$) 

♦ People (SPEOPLES) 

♦ Location (SLOCATIONS) 

♦ Time ($T1ME$) 

♦ Topic ($TOPIC_UPPER$) or (STOPIC_ALL$) 

20 In parentheses are the placeholders I used in my code as representation of the corresponding 
meeting fields. 



E ach pl a cehold e r has th e fo llo w i ng m ea n i ng :. 



♦ SCOMPANYS: binds a string of capitalized words (e.g. Meet with Joe Carter of 
25 <Andersen Consulting >) 

♦ $PEOPLE$: binds scries of string of two capitalized words potentially connected by 
" " "and" or (e.g. Meet with <Joe Carter> of Andersen Consulting, Meet with 
<Joe Carter and Luke Hughes> of Andersen Consulting) 

♦ SLOCATIONS: binds a string of capitalized words (e.g. Meet Su$an at <Palo Alto 
30 Square>) 

♦ STIMES: binds a string containing the format #:## (e,g. Dinner at <6:30 pm>) 

25 
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♦ STOPICJJPPERS: binds a string of capitalized words for our topic (e.g. <Stanford 
Engineering kecnriting> Meeting to talk about new hires). 

♦ $TOPIC_ALL$: binds a string of words without really caring if it's capitalized or not. 
(e.g. Meet to talk about ^ubiquitous computings) 

5 Here is a table representing all the patterns supported by BF« Each pattern belongs to a pattern 
group. All patterns within a pattern group share a similar format and they only differ from each 
other in terms of what indicators are used as substitutes. Note that the patterns which are grayed 
out are also commented in the code. BF has the capability to support these patterns but we 
decided that -matching these patterns' is not essential at this point 

10 



PAT 


PAT 

n 


PATTERN 


EXAMPLE 


GRP 








1 


a 


SPEOPLES of 
SCOMPANYS 


Paul Maritz of Microsoft 




b 


$PEOPLE$ from 
SCOMPANYS 


Bill Gates, Paul Allen and 
Paul Maritz from Microsoft 


2 


a 


STOPICJJPPERS meeting 


Push Technology Meeting 




b 


£TOPIC_UPPER$ mtg 


Push Technology Mtg 




c 


JTOPIC_UPPER$ demo 


Push Technology demo 




d 


JTOPIC_UPPER$ 
interview 


Push Technology interview 




e 


$TOPIC_UPPER$ 
presentation 


Push Technology 
presentation 




f 


STOPICJJPPERS visit 


Push Technology visit 




g 


STOPICJJPPERS briefing 


Push Technology briefing 




h 


STOPICJJPPERS 
discussion 


Push Technology 
discussion 




i 


STOPICJJPPERS 
workshop 


Push Technology 
workshop 




j 


STOPIC_UPPER$ prep 


Push Technology prep 




k 


STOPIC_UPPER$ review 


Push Technology review 



26 
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1 


$TOPIC_UPPER$ lunch 


Push Technology lunch 






m 


STOPICJUPPERS project 


Push Technology project 




n 


5TOPIC_UPPER$ projects 


Push Technology projects 


3 


a 


SCOMPANYS corporation 


Intel Corporation 




b 


SCOMPANYS corp. 


IBM Corp. 




c 


$COMPANY$ systems 


Cisco Systems 




d 


SCOMPANYS limited 


IBM limited 

m m A w A\ A A A A mm feww 




e 


SCOMPANYS ltd 


IBM ltd 


4 


a 


about $TOPlC_ALL$ 


About intelligent agents 




b 


discuss $TOPIC_ALL$ 


Discuss intelligent agents 

LCwiiriuiugy 




c 


show $TOPIC_ALL$ 


Show the client our 
technology 




0 


rc: STOPlC_ALL$ 


rc: intelligent agents 
technology 




e 


review $TOPlC_ALLS 


Review intelligent agents 
technology 




f 


agenda 


The agenda is as follows: 
—clean up 
— clean up 
—clean up 




g 


oft^rlHo- ^TOPIf — AT T t 

agenda. ^ i v^riv-._/vi-i-r4> 


—demo client intelligent 

QLvl IIO IwwIlllUlufiTi 

—demo ecommerce. 




5 


a 


w/SPEOPLES of 
SCOMPANYS 


Meet w/Joc Carter of 
Andersen Consulting 






b 


w/SPEOPLE$ from 
SCOMPANYS 


Meet w/Joe Carter from 
Andersen Consulting 




6 


a 


w/$COMPANY$ per 


Talk w/Intel per Jason 
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SPEOPLES 


Foster 


7 


a 


At $TJME$ 


at 3:00pm 




b 


Around STIMES 


Around 3:00 pm 


8 


a 


Al SLOCATJONS 


At LuLu*s rcsiurant 




b 


In SLOCATIONS 


in Santa Claret 


9 


a 


Per SPEOPLES 


per Susan Butler 


10 


a 


call w/SPEOPLES 


Conf call w/John Smith 




B 


call with SPEOPLES 


Conf call with John Smith 


1 1 


A 


prep for $TOPIC_ALL$ 


Prep for London meeting 




8 


preparation Tor 
$TOPIC_ALL$ 


Preparation for London 
meeting 



Figure 4 is a detailed flowchart of pattern matching in accordance with a preferred embodiment. 
Processing commences al function block 400 where the main program invokes the pattern 
5 mulching application and passes control io function block 410 lo commence ihc pattern match 

processing. Then, at funciion block 420, the wrapper function loops through io process each 
pailcrn which includes determining if a pari of Ihc text string can be bound lo a paltcm as shown 
in function block 430. Then, at function block 440, various placeholders are bound lo values if 
they exist, and in function block 441, a lisl of names separated by punctuation arc bound, and at 

10 function block 442 a full name is processed by finding two capitalized words as a full name and 

grabbing the next letter after a space aAcr a word to determine if it is capitalized. Then, at 
function block 443, time is parsed out of the siring in an appropriate manner and the next word 
after a blank space in function block 444. Then, al funciion block 445, the continuous phrases of 
capitalized words such as company, topic or location are bound and in function block 446, the 

15 next word after the blank is obtained for further processing in accordance with a preferred 

embodiment Following the match meeting field processing, function block 450 is utilized to 
loactc an indicator which is the head of a pattern, the next word after the blank is obtained as 
shown in function block 452 and the word is checked lo determine if the word is an indicator as 
shown in function block 454, Then, at funciion block 460, the string is parsed to locate an 

20 indicator which is not at the end of the pattern and the next word aAcr unnecessary while space 

such as that following a line feed or a carriage return is processed as shown in function block 462 

28 
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4 

and the word is analyzed to determine if it is an indicator as shown in function block 464. Then, 
in function block 470, the temporary record is reset to the null set to prepare it for processing the 
next string and at function block 480, the meeting record is updated and al fundion block 482 a 
check is performed to determine if an entry is already made to the meeting record before parsing 
5 the meeting record again. 

USING THE IDENTIFIED MEETING FIELDS 

Now that we have identified fields within the meeting text which we consider important, there 
are quite a few things we can do with it. One of the most important applications of pattern 
1 0 matching is of course to improve the query we construct which eventually gets submitted to Alta 
Vista and News Page. There arc also a lot of other options and enhancements which exploit the 
results of pattern matching that we can add to BF. These other options will be described in the 
next section. The goal of this section is lo give the reader a good sense of how the results 
obtained from pattern matching can be used to help us obtain better search results. 

15 

Figure 5 is a flowchart of the detailed processing for preparing a query and obtaining information 
from the Internet in accordance with a preferred embodiment. Processing commences al function 
block 500 and immediately flows to function block SlO to process the wrapper functionality to 
prepare for an Inicmei search utilizing a web search engine. If the search is to utilize the Alta 
20 Vista search engine, then at function block 530, the system takes information from the meeting 
record and forms a query in function blocks 540 to 560 for submittal to the search engine. If ihc 
search is to utilize the NewsPagc search engine, then at function block 520, the system takes 
information from the meeting record and forms a query in function blocks 521 lo 528. 

25 Alta Vista Search Engine 

The strength of the Alta Vista search engine is that it provides enhanced flexibility. Using its 
advance query method, one can construct all sorts of Boolean queries and rank ihc search 
however you want. However, one of the biggest drawbacks with Alta Vista is that it is not very 
good at handling a large query and is likely to give back irrelevant results. If we can identify the 

30 topic and the company within a meeting text, wc can form a pretty short hut comprehensive 

query which will hopefully yield better results. We also want to focus on the topics found. It 
may not be of much merit to the user to find out info about a company especially if the user 

29 
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already knows the company well and has had numerous meetings with them. It's the topics they 
want to research on. 



News Page Search Engine 

5 The strength of the News Page search engine is that it does a great job searching for the most 

recent news if you are able to give it a valid company name. Therefore when we submit a query 
to the news page web site, we send whatever company name we can identify and only if we 
cannot find one do we use the topics found to form a query. If neither one is found, then no 
search is performed. The algorithmn utilized to form the query to submit to Aha Vista is 
10 illustrated in Figure 7. The algorithmn that we will use to form the query to submit to News 
Page is illustrated in Figure 8. 

The following table describes in detail each function in accordance with a preferred embodiment. 
The order in which functions appear mimics the process flow as closely as possible. When there 
are situations in which a function is called several limes, this function will be listed after the first 
15 function which calls it and its description is not duplicated after every subsequent function which 

calls it 



Procedure 
Name 


Type 


Called By 


Description 




Main 

(BF.Main) 


Public 
Sub 


None 


This is the main function 
where I he program first 
launches. It initializes BF 
with the appropriate 
paramelers(e«g> Internet time 








out, stoplist.. .) and calls 
GoBF to launch the main 
pan of the program. 




ProcessCom 

mandLine 

(BF.Main) 


Private 
Sub 


Main 


This function parses the 
command line. It assumes 
that the delimiter indicating 
the beginning of input from 
Munin is stored in the 
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Procedure 
Name 


Type 


Called By 


Description 












constant 

CMD_SEPARATOR- 




CreateStopLi 

St 

(BF.Main) 


Private 
Function 


Main 


This function sets up a stop 
list for future use to parse out 
unwanted words from the 
meeting text. 

There are commas on each 
side of each word to enable 
straight checking. 


CreatePattem 

s 

(BF.Pattem 
Match) 


Public 
Sub 


Main 


This procedure is called once 
when BF is first initialized to 
create all the potential 
patterns that portions of the 
meeting text can bind to. A 
pattern can contain however 
many elements as needed. 
There are 

two types of elements. The 
first type of elements are 
indicators. These are real 
words which delimit the 
potential of a meeting field 











(eg company) to follow. 
Most of these indicators are 
stop words as expected 
because 

stop words are words 
usually common to all 
meeting text so it makes 
sense they form patterns. The 
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Procedure 
Name 


Type 


Called By 


Description 










second type of elements are 
special strings which 
represent placeholders. 
A placeholder is always in 
the form of $*$ where * can 
be either PEOPLE, 
COMPANY, 
TOPICJJPPER, 
TIME.LOCATION or 
TOPIC_ALL. A pattern can 
begin with either one of the 
two types of elements and 
can be however long, 
involving however any 
number/type of elements. 
This procedure dynamically 
creates a new pattern record 
for 

each pattern in the table and 
it also dynamically creates 
new tAPattemElements for 
each element within a 











pattern. In addition, there is 
the concept of being able to 
substitute indicators within a 
pattern. For example, the 
pattern SPEOPLES of 
SCOMPANYS is similar to 
the pattern SPEOPLES from 
$COMPANY$. "from" is a 
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Procedure 
Name 


Type 


Called By 


Description 








substitute for "of . Our 
structure should be able to 
express such a need for 
substitution. 


GoBF 
(BF.Main) 


Public 
Sub 


Main 


This is a wrapper procedurer 
that calls both the parsing 
and the searching subroutines 
of the 

BF* It is also responsible for 
sending data back to Munin. 


ParseMeetin 

gText 

(BF.Parse) 


Public 
Function 


GoBackGroundF 
inder 


This function takes the initial 
meeting text and identifies 
the userlD of the record as 
well as other parts of the 
meeting text including the 
title, body, participant list, 
location and time. In 
addition, we call a helper 
function ProcessStopList to 
eliminate ail the unwanted 
words from the original 
..meeting title and meeting 






— 1 




body so that only keywords 
are left. The information 
parsed out is stored in the 
MeetingRecord structure. 
Note that this function does 
no error checking and for the 
most time assumes that the 
meeting text string is 
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Procedure 
Name 


Type 


Called By 


Description - 












correctly formatted by 
Munin. 

The important variable is 
thisMeeting Record is the 
temp holder for all info 
regarding current meeting. 
It's eventually returned to 
caller. 


FormatDelim 
i tati on 
(BF.Parse) 


Private 


ParseMeetingTc 
xt, 

DetermineNum 
Words, 

GetAWordFrom 
String 


There are 4 ways in which 
the delimiters can be placed. 
We take care of all these 
cases by reducing them 
down to Case 4 in which 
there are no delimiters 
around but only between 
fields in a string(e.g. 
A::B;:C) 


DetermineNu 

mWords 

(BF.Parse) 


Public 
Function 


ParseMeeting 
Text, 

ProcessSiop 
List 


This functions determines 
how many words there are in 
a string (stlnEvalString) The 
function assumes that each 
word is separated by a 











designated separator as 
specified in stSeparator. The 
return type is an integer that 
indicates how many words 
have been found assuming 
each word 

in the string is separated by 
stSeparator. This function is 
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Procedure 


Type 


Called By 


Description 


Name 














always used along with 








GetA WordFromS tring and 








should be called before 








calling GetAWordFrom 








String* 


GetAWordFr 


Public 


ParseMeeting 


This function extracts the ith 


omString 


Function 


Text, 


word of the 


(BF,Parse) 




ProcessStop 
List 


string(stlnEvalString) 
assuming that each word in 
the string is separated by a 
designated 

separator contained in the 
variable stSeparator. 
In most cases, use this 
function with 

DetennineNum Words. The 
luncuon reiunis inc wanieti 
word. This function checks 
to make sure that 
ilnWordNum is within 
bounds so that i 
is not greater than the total 

a . 








number of words in string or 








less than/equal to zero. If it 








is out of bounds, we return 








empty string to indicate we 








can't get anything. We try to 








make sure this doesn't 








happen by calling 








DetermineNum Words first. 
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Procedure 
Name 


Type 


Called By 


Description 


ParseAndCle 


Private 


ParseMeetingTe 


This function first grabs the 


anPhrase 


Function 


xt 


word and send it to 


(BRParse) 






Clean Word in order strip 








the stuff that nobody wants. 








There are things in 








parseWord that will kill 








the word, so we will need a 








method of looping through 








the body and rejecting 








words without killing the 








whole function 








i guess keep Clean Word and 








check a return value 








ok, now I have a word so I 








need to send it down the 








parse chain. This chain goes 








ParseCleanPhrase -> 








Clean Word -> 








EvaluateWord- If the word 








gets through the 








entire chain without being 








killed, it will be added at the 








end to our keyword siring, 
first would be the function 
that checks for "/" as a 
delimiter and extracts the 
parts of thai. This I will call 
"StitchFace" (Denise is more 
normal and calls it 
GetAWordFromString) 
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Procedure 


Type 


Called By 


Description 


Name 














if this finds words, then each 








of these will be sent, in turn* 








down the chain. If 








these get through the entire 








chain without being added or 








killed then they will be 








added rather than tossed. 


FindMin 


Private 


Parse AndCleanP 


This function takes in 6 input 


(BF.Parse) 


Function 


hrase 


values and evaluates to see 








what the minimum non 








zero value is. It first creates 








an array as a holder so that 








we can son the five 








input values in ascending 








order Thus the minimum 








value will be the first non 








zazikj value ci cm cm oi uic 








array. If we go through 








entire array without finding 








a non zero value, we know 








that there is an error and we 








exit the function, 










CleanWord 


Private 


ParseAndCleanP 


This function tries to clean 


(BF.Parse) 


Function 


hrase 


up a word in a meeting text. 








It first of all determines if the 








string is of a valid length. It 








then passes it through a 








series of tests to see it is 








clean and when needed, it 








will edit the word and strip 
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Procedure 
Name 


Type 


Called By 


Description 








unnecessary characters off of 
it. Such tests includes 
getting rid of file extensions, 
non chars, numbers etc. 


EvaluateWor 
d 

(BF.Parse) 


Private 
Function 


ParseAndCIeanP 
hrase 


This function tests to see if 
this word is in the stop list so 
it can determine whether to 
eliminate the word from the 
original meeting text. If a 
word is not in the stoplist* it 
should stay around as a 
keyword and this function 
exits beautifully with no 
errors. However, if the 
words is a stop word, an error 
must be returned. We must 
properly delimit the input 
test string so we don't 
accidentally retrieve sub 
strings. 


GoPatternMa 
tch 


Public 
Sub 


GoBF 


This procedure is called 
when our QueryMethod is 




(BF.Pattern 
Match) 






set to complex query 
meaning we do want to do all 
the pattern matching stuff Jt 
's a simple wrapper function 
which initializes some arrays 
and then invokes pattern 
matching on the title and the 
body. 
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Procedure 
Name 


Type 


Called By 


Description 




< 


MatchPaltern 
s 

(BF.Pattern 
Match) 


Public 
Sub 


GoPattem Match 


This procedure loops through 
every pattern in the pattern 
table and tries to identify 
different fields within a 
meeting text specified by 
slnEvalString, For 
debugging purposes it also 
tries to tabulate how many 
times a certain pattern was 
triggered and stores it in 
gTabulateMatches to see 
whichp pattern fired the 
most. gTabulateMatches is 
stored as a global because we 
want to be able to run a batch 
file of 40 or 50 test strings 
and still be able to know how 
often a pattern was triggered. 


MatchAPatte 
m 

(BF,Pattern 
Match) 


Private 
Function 


MatchPattems 


This function goes through 
each element in the current 
pattern. It first evaluates to 
determine whether element is 










a placeholder or an indicator. 
If it is a placeholder, then it 
will try to bind the 
placeholder with some value. 
If it is an indicator, then we 
try to locate it. There is a 
trick, however. Depending on 
whether we are at current 
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Procedure 
Name 


Type 


Called By 


Description 










element is the head of the 
pattern or 

not we want to take 
different actions. If we are 
at the head, we want to 
look for the indicator or 
the placeholder. If we 
can't find it, then we 
know that the current 
pattern doesn't exist and 
we quit. However, if it is 
not the head, then we 
continue looking, because 
there may still be a head 
somewhere. We retry in 
this case. 


etingField 
(BF.Pattern 
Match) 


Private 
Function 


MatchAPattern 


This function uses a big 
switch statement to first 
determine what kind of 
placeholder we are talking 
about and depending on what 
type of placeholder, we have 






i 




specific requirements 
and different binding criteria 
as specified in the 
subsequent functions called 
such as BindNames, 
BindTime etc. If binding is 
successful we add it to our 
guessing record. 
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Procedure 


Type 


Called By 


Description 


Name 








BindNames 


Private 


MatchMeetingFi 


In this function, we try to 


(BF.Pattcm 


Function 


eld 


match names to the 


Match) 






corresponding placeholder 








SPEOPLES. Names are 








defined as any consecutive 








two words which are 








capitalized! We also what to 








retrieve a series of names 








which are connected by and , 








or & so we look until we 








don't see any of these 3 








separators anymore. Note 








that we don 't want to bind 








single word names because it 








is probably 








too general anyway so we 








don't want to nroduce broad 








but irrelevant results. This 








function calls 








BindAFulLName which binds 








one name so in a since 








BindNames collects all the 








results from BindAFullName 


BindAFullNa 


Private 


BindNames 


This function tries to bind a 


me 


Function 




full name. If the $ PEOPLES 


(BF.Pattern 






placeholder is not the head of 


Match) 






the pattern, we know that it 








has to come right at the 








beginning of the test string 








because we Ve been deleting 
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Procedure 
Name 


Type 


Called By 


Description 










stuff off the head of the 
string all along. 
If it is the head, we search 
until we find something that 
looks like a full name. If we 
can't find it, then there's no 
such" pattern in the text 
entirely and we quit entirely 
from this pattern. This 
should eventually return us 
to the next pattern in 
MatchPattems. 


GeiNextWor 

dAfterWhite 

Space 

(BF.Pattem 

Match) 


Private 
Function 


BindAFuIl 

Name, 

BindTime, 

BindCompanyTo 

picLoc 


This function grabs the next 
word in a test string. It looks 
for the next word after white 
spaces, @ or /. The word is 
defined to end when we 
encounter another one of 
these white spaces or 
separators. 


BindTime 
(BF.Pattern 


Private 
Function 


MatchMeelingF i 
eld 


Get the immediate next word 
and see if it looks like a time 




Match) 






pattern. If so we*ve found a 
time and so we want to add it 
to the record. We probably 
should add more time 
patterns. But people don't 
seem to like to enter the time 
in their titles these days 
especially since we now have 
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Procedure 
Name 


Type 


Called By 


Description 










tools like OutLook. 


BiiidCompan 
yTopicLoc 
(BF.Pattem 
Match) 


Private 
Function 


MatchMeetingFi 
eld 


This function finds a 
continuous capitalized string 
and binds it to stMatch 
which is passed by reference 
from MatchMeetingField, A 
continous capitalized string 
is a sequence of capitalized 
words which are not 
interrupted 

by things like , . etc. There's 
probably more stuff we can 
add to the list of 
interruptions. 


LocatePaner 
nHead 

/tip* Pattern 

Match) 


Private 
Function 


MatchAPattem 


This function tries lo locate 
an element which is an 

■■rtHif*afrtr Yvlrtl^ that thic 

indicator SHOULD BE AT 
THE HEAD of the pattern 
otherwise it would have gone 
to the function 
Locatelndicator instead. 










Therefore, we keep on 
grabbing the next word until 
either there's no word for us 
to grab (quit) or if we And 
one of the indicators we are 
looking for 




ContainlnArr 
ay 


Private 
Function 


LocatePattern 
Head, 


' This function is really 
simple. It loops through all 
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Procedure 
Name 


Type 


Called By 


Description 




(BF.Pattem 
Match) 




Locatelndicator 


the elements in the array 
' to find a matching string. 


Locatelndicat 
or 

(BFJ*attcm 
Match) 


Private 
Function 


MatchAPattcm 


This function tries to locate 
an element which is an 
indicator. Note that this 
indicator is NOT at the head 
of the pattern otherwise it 
would have gone to 
LocatePatternHead instead. 
Because of this, if our 
pattern is to be satisfied, the 
next word we grab HAS to 
be the indicator or else we 
would have failed. Thus we 
only grab one word, test to 
see if it is a valid indicator 
and then return result- 


InitializeGue 
ssesRecord 
(BRPattem 
Match) 


Private 
Sub 


MaichAPattem 


This function reinitializes our 
temporary test structure 
because we have already 
transfered the info to the 
permanent structure, we can 










reinitialize it so they each 
have one element 




AddToMeeti 
ngRecord 
(BF.Pattern 
Match) 


Private 
Sub 


MatchAPattem 


This function is only called 
when we know that the 
information stored in 
tlnCurrGuesses is valid 
meaning that it represents 
legitimate guesses of 
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Procedure 
Name 


Type 


Called By 


Description * 








meeting fields ready to be 
stored in the permanent 
record.tlnMeetingRecord . 
We check to make sure that 
we do not store duplicates 
and we also what to clean up 
what we want to store so that 
there's no cluttered crap such 
as punctuations, etc. The 
reason why we don't clean up 
until now is to save time. We 
don't waste resources calling 
Parse AndCleanPhrase until 
we know for sure that we are 
going to add it permanently. 


NoDuplicate 
Entry 

(BF.Pattem 
Match) 


Private 
Function 


AddToMectingR 
ecord 


This function loops through 
each element in the array to 
make sure that the test string 
aString is not the same as 
any of the strings already 
stored 

in the array. Slightly 










different from 
ContainlnArray. 


SearchAltaVi 
sta 

(BF.Search) 


Public 
Function 


GoB ackGroundF 
inder 


This function prepares a 
query to be subxnited to 
AltaVista Search engine. It 
submits it and then parses the 
returning result in the 
appropriate format 
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Procedure 
Name 


Type 


Called By 


Description 










containing the title, URL and 
body/summary of each story 
retrieved. The number of 
stories retrieved is specified 
by the constant 
NUM_AV_STORIES- 
Important variables include 
stLERLAltaVista used to store 
query to submit 
stResuHHTML used to store 
html from page specified by 
stURLAltaVista. 


ConstructAlt 

aVistaURL 

(BF.Search) 


Private 
Function 


Search Alia Vista 


This function constructs the 
URL string for the alia vista 
search engine using the 
advanced query search mode. 
It includes the keywords to 
be used, the language and 
how we want to rank the 
search. Depending on 
whether we want to use the 
results of our pattern 










matching unit, we construct 
our query differently. 




Constructs^ 

mpleKeyWor 

d 

(BF.Search) 


Private 
Function 


ConStruetAltaVj 
staUR], 

ConstructNewsP 
ageURL 


This function marches down 
the list of keywords stored in 
the stTitleKW or stBodyKW 
fields of the input meeting 
record and links them up into 
one string with each keyword 
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Procedure 
Name 


Type 


Calied By 


Description 








separated by a connector as 
determined by the input 
variable stlnConnector. 
Returns this newly 
constructed string. 


ConstructCo 
mplexAVKe 
yWord 
(BFSearch) 


Private 
Function 


ConstructAltaVi 
staURL 


This function constructs the 
keywords to be send to the 
AltaVista site. Unlike 
ConstructSimpleKeyWord 
which simply takes all the 
keywords from the title to 
form the query, this function 
will look at the results of BF 
'$ pattern matching process 
and see if we are able to 
identify any specific 
company names or topics for 
constructing 
the queries. Query will 
include company and topic 
identified and default to 

simple.query if we cannot 

identify either company or 
topic. 










JoinWithCon 

nectors 

(BF.Search) 


Private 
Function 


ConstructCompl 

cxAVKey 

Word, 

ConstructCompl 

exNPKey 

Word, 


This function simply replaces 
the spacesbetween the words 
within the string with a 
connector which is specified 
by the input 
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Procedure 
Name 


Type 


Called By 


Description 








RefineWith 
Rank 




Refine WithD 
ate (NOT 
CALLED 
AT THE 
MOMENT) 
(BF.Search) 


Private 
Function 


ConstructAl t a V i 
staURL 


This function constructs the 
date portion of the alta vista 
query and returns this portion 
of the URL as a string. It 
makes sure that alta vista 
searches for articles within 
the past PAST_NDAYS_ 


RefineWithR 
ank 

(BF.Search) 

> 


Private 
Function 


ConstructAltaVi 
staURL 


This function constructs the 
string needed to passed to 
Altavista in order lo rank an 
advanced query search. If 
we are constructing the 
simple query we will take in 
all the keywords from the 
title. For the complex query, 
we will take in words from 
company and topic, much the 
same way we formed the 
query in 

ConstructComplexAVKeyW 










ord. 




IdentifyBloc 
k 

(BF.Parse) 


Public 
Function 


ScarchAltaVista* 
SearchNewsPage 


This function extracts the 
block within a string marked 
by the beginning and the 
ending tag given as inputs 
starting at a certain 
location(iStart). The block 
retrieved does not include the 
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Procedure 
Name 


Type 


Called By 


Description 










tags themselves. If the block 
cannot be identified with the 
specified delimiters, we 
return unsuccessful through 
the parameter 

iRetumSuccess passed to use 
by reference. The return type 
is the block retrieved. 


IsOpenURL 

Error 

(BR-Enor) 


Public 
Function 


SearchAl taVista, 
SearchNewsPagc 


This function determines 
whether the error 
encountered is that of a 
timeout error. It restores the 
mouse to default arrow and 
then returns true if it is a time 
out or false otherwise. 


SearchNews 

Paee 

(BF.Search) 


Public 
"Fiinetiflri 


GoBackGroundF 
inder 


This function prepares a 

UUCIjr IU UC bUDinilCQ lO 

NewsPage Search 
engine. It submits it and then 
parses the returning result in 
the appropriate format 
cpnt^ining the title, UKt .and 










body/summary of each story 
retrieved. The number of 
stories retrieved is specified 
by the constant 
UM_NP_STORIES 




ConstructNe 
wsPageURL 
(BF.Search) 


Private 
Function 


SearchNewsPage 


This function constructs the 
URL to send to the 
NewsPage site. It uses the 
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Procedure 
Name 


Type 


Called By 


Description ■ 










information contained in the 
input meeting record to 
determine what keywords to 
use. Also depending whether 
we want simple or complex 
query, we call diffem 
functions to form strings. 


ConstructCo 

mplexNPKey 

Word 

(BF.Search) 


Private 
Function 


ConstructNewsP 
ageURL 


This function constructs the 
keywords to be send to the 
NewsPage site. 
UnlikeConstructKey WordS tr 
ing which simply takes all 
the keywords from the title to 
form the query, this function 
will look at the results of BF 
's pattern matching process 
and see if we are able to 
identify any specific 
company names or topics for 
constructing 

the queries. Since newspage 
works best when we have a 










company name, we '11 use 
only the company name and 
only if there is no company 
will we use topic. 




ConstructOv 

erallResult 

(BF.Main) 


Private 
Function 


GoBackGroundF 
inder 


This function takes in as 
input an array of strings 
(stlnStories) and a 
MeetingRecord which stores 
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Name 


Type 


Called By 


Description- 












the information for the 
current meeting. Each 
element in the array stores 
the stories retrieved from 
each information source. 
The function simply 
constructs the appropriate 
output to send to Munin 
including a return message 
type to let Munin know that 
it is the BF responding and 
also the original user_id and 
meeting title so Munin 
knows which meeting BF is 
talking about. 


ConnectAnd 
Trans ferTo 
Munin 
(BF.Main) 


Public 

Cult 


GoBackGroundF 
inder 


This function allows 
rsacKgrouno rinaer 10 
connect to Munin and 
eventually transport 
information to Munin. We 
will be using the UDP 
protocol instead of the TCP 










protocol so we have to set up 
the remote host and port 
correctly. We use a global 
string to store gResult 
Overall because although it 
is unecessary with UDP, it is 
needed with TCP and if we 
ever switch back don't want 
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Procedure 
Name 


Type 


Called By 


Description 








to change code. 


uiscoiuicCLr r 

omMuninAn 

d 

Quit 

(BRMain) 


rUDilC 
Sub 





Figure 6 is a flowchart of the actual code utilized to prepare and submit searches to the Alta Vista 
and Newspage search engines in accordance with a preferred embodiment. Processing 
commences at function block 61 0 where a command line is utilized to update a calendar entry 
5 with specific calendar information. The message is next posted in accordance with function 

block 620 and a meeting record is created to store the current meeting information in accordance 
with function block 630. Then, in function block 640 the query is submitted to the Alta Vista 
search engine and in function block 650, the query is submitted to the Newspage search engine. 
When a message is returned from the search engine, it is stored in a results data structure as 
10 shown in function block 660 and the information is processed and stored in summary form in a 
file for use in preparation for the meeting as detailed in function block 670. 



Figure 7 provides more detail on creating the query in accordance with a preferred embodiment. 
Processing commences at function block 71 0 where the meeting record is parsed to obtain 
potential companies, people, topics, location and a time. Then, in function block 720, at least 
one wp k Is identinea ana in function block 720, at least one company name is identifted'and" 
finally in function block 740, a decision is made on what material to transmit to the file for 
ultimate consumption by the user. 



Figure 8 is a variation on the query theme presented in Figure 7. A meeting record is parsed ii 
function block 800, a company is identified in function block 820, a topic is identified in 
function block 830 and finally in function block 840 the topic and or the company is utilized i 
formulating the query. 
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Alternative embodiments for adding various specific features for specific user requirements are 
discussed below. 

5 Enhance Target Rate for Pattern Matching 

To increase BF's performance, more patterns/pattern groups are added to the procedure 
"CreatePatiems" The existing code for declaring patterns can be used as a template for future 
patterns. Because everything is stored as dynamic arrays, il is convenient to reuse code by 

10 cutting and pasting. The functions BindName, BindTimc, BindCompanyLocTopic which are 
responsible for associating a value with a placeholder can be enhanced. The enhancement is 
realized by increasing the set of criteria for binding a certain meeting field in order to increase 
the number of binding values. For example, BindTimc currently accepts and binds all values in 
the form of ##:## or To increase the times we can bind, we may want BindTimc to also 

1 5 accept the numbers 1 to 12 followed by the more aesthetic lime terminology "o'clock." 

Vocabulary based recognition algorithms and assigning an accuracy rate to each guess BF makes 
allowing only guesses which meet a certain threshold to be valid. 

Depending on whnl location Ihc system identifies through pnllcni matching or allcmntivcly 
20 depending on what location the user indicates as the meeting place, a system in accordance with 
a preferred embodiment suggests a plurality of fine restaurants whenever it detects the words 
lunch/dinncr/brcakfast. We can also use a site like company finder to confirm what we got is 
indeed a company name or if there is no company name that pattern matching can identify, we 

ea n u se a co mp any find er web s i te a s a "dictionary" fu i us> to dciciiuiuu whethe r ce r tain 

25 capitalized words represent a company name. We can even display stock prices and breaking 
news for a company that we have identified. 
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Wireless Bargain Identification in Accordance With A Preferred Embodiment 

Figure 9 is a flow diagram that depicts the hardware and logical flow of control for a device and 
5 a software syslem designed to allow Web-based comparison shopping in conventional, physical, 
non-Web retail environments. A wireless phone or similar hand-held wireless device 920 with 
Internet Protocol capability is combined with a miniature barcode reader 910 (installed either 
inside the phone or on a short cable) and used to scan the Universal Product Code (UPC) bar 
code on a book or other product 900. The wireless device 920 transmits the bar code via an 

10 antennae 930 to the Pocket BargainFindcr Service Module (running on a Web server) 940, which 
converts it to (in the case of books) its International Standard Book Number or (in the case of 
other products) whatever identifier is appropriate. The Service Module then contacts the 
appropriate third-party Web site(s) to find price, shipping and availability information on the 
product from various Web suppliers 950. This information is formatted and displayed on the 

1 5 hand-held device's screen. The IP wireless phone or other hand held device 920 utilizes a 

wireless modem such as a Ricochet SE Wireless Modem from Metricom. Utilizing this device, a 
user can hang out in a coffee shop with a portable computer perched on a rickety little table, with 
a latlc sloshing dangerously close to the keyboard, and access the Internet at speeds rivaling 
direct connect via a telephone line. 

20 

The 8 -ounce Ricochet SE Wireless Modem is about as large as a pack of cigarettes and setup is 
extremely simple, simply attach the modem to the back of your portable's screen with the 
included piece of Vclcro, plug the cable into the serial port, flip up the stubby antenna, and 
transmit. Software setup is equally easy: a straightforward installer adds the Ricochet modem 
25 drivers and places the connection icon on your desktop. The functional aspects of the modem arc 
identical to that of a traditional telephone modem. 

Of course, wireless performance isn't nearly as reliable as a traditional dial-up phone connection. 
We were able to get strong connections in several San Francisco locations as long as we stayed 
30 near the windows. But inside CNET's all-brick headquarters, the Ricochet couldn't connect at all. 
When you do get online, performance of up to 28-8 kbps is available with graceful degradation to 
slower speeds. But even the slower speeds didn't disappoint. Compared to the alternative- 
connecting via a cellular modem—the Ricochet is much faster, more reliable, and less expensive 
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to use. Naturally, the SE Wireless is battery powered. Th& modem has continuous battery life of 
up to 12 hours. And in accordance with a preferred embodiment, we ran down our portable 
computer's dual cells before the Ricochet started to fade, 

5 Thus, utilizing the wireless modem, a user may utilize the web server software 940 to identify 

the right product 950 and then use an appropriate device's key(s) to select a supplier and place an 
order in accordance with a preferred embodiment. The BargainFinder Service Module then 
consummates the order with the appropriate third-party Web supplier 960. 

10 my Site! Personal Web Site & Intentions Value Network Prototype 

mySile! is a high-impact, Internet-based application in accordance with a preferred embodiment 
thai is focused on the theme of delivering Services and providing a personalized experience for 
each customer via a personal web site in a buyer-centric world. The services are intuitively 

15 organized around satisfying customer intentions - fundamental life needs or objectives that 

require extensive planning decisions, and coordination across several dimensions, such as 
financial planning, healthcare, personal and professional development, family life, and other 
concerns. Each member owns and maintains his own profile, enabling him to create and browse 
content in the system targeted specifically at him. From the time a demand for products or 

20 services is entered, to the completion of payment, intelligent agents arc utilized to conduct 

research, execute transactions and provide advice. By using advanced profiling and filtering, the 
intelligent agents learn about the user, improving the services they deliver. Customer intentions 
include Managing Daily Logistics (e.g., email, calendar, contacts, to-do list, bill payment, 
shopping, and travel planning); and Moving to a New Community (e.g., finding a place to live, 

"Z5 moving household possessions, getting travel anB~snTpping insurance coverage, notifying 
business and personal contacts, learning about the new community). From a consumer 
standpoint, mySite! provides a central location where a user can access relevant products and 
services and accomplish daily tasks with ultimate ease and convenience. 

30 From a business standpoint, mySite! represents a value-added and innovative way to effectively 

attract, service, and retain customers. Intention value networks allow a user to enter through a 

personalized site and, and with the assistance of a learning, intelligent agent, seamlessly interact 

with network participants. An intention value network in accordance with a preferred 
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embodiment provides superior value. It provides twenty four hour a day, seven days a week 
access to customized information, advice and products. The information is personalized so that 
each member views content that is highly customized to assure relevance to the required target 
user. 

5 Egocentric Interface 

An Egocentric Interface is a user interface crafted to satisfy a particular user's needs, preferences 
and current context. It utilizes the user's personal information that is stored in a central profile 
database to customize the interface. The user can set security permissions on and preferences for 
interface elements and content. The content integrated into the Egocentric interface is 

1 0 customized with related information about the user. When displaying content, the Egocentric 
Interface will include the relationship between that content and the user in a way that 
demonstrates how the content relates to the user. For instance, when displaying information 
about an upcoming ski trip the user has signed up for, the interface will include information 
about events from the user's personal calendar and contact list, such as other people who will be 

15 in the area during the ski trip. This serves to put the new piece of information into a context 

familiar to the individual user. 

Figure 10A describes the Intention Value Network Architecture implementation for the World 
Wide Web, For simplification purposes, this diagram ignores the complexity pertaining to 

20 security, scalability and privacy. The customer can access the Intention Value Network with any 
internet web browser 1 01 0, such as Netscape Navigator or Microsoft Internet Explorer, running 
on a personal computer connected to the Internet or a Personal Digital Assistant with wireless 
capability. Sec Figure 17 for a more detailed description of the multiple methods for accessing 
an Intention Value Network. The customer accesses the Intention Vaiue Network through the 

25 unique name or IP address associated with the Integrator's Web Server 1020. The Integrator 

creates the Intention Value Network using a combination of resources, such as the Intention 
Database 1030, the Content Database 1040, the Supplier Profile Database 1050, and the 
Customer Profile Database 1060. 

30 The Intention Database 1030 stores all of the information about the structure of the intention and 

the types of products and services needed to fulfill the intention. Information in this database 

includes intention steps, areas of interest, layout templates and personalization templates. The 
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Content Database 1040 stores all of the information related to the intention, such as advice, 
referral information* personalized content, satisfaction ratings, product ratings and progress 
reports. 

5 The Supplier Profile Database 1050 contains information about the product and service providers 
integrated into the intention. The information contained in this database provides a link between 
the intention framework and the suppliers. It includes product lists, features and descriptions, 
and addresses of the suppliers' product web sites. The Customer Profile Database 1060 contains 

- personal information about the customers, such as- name; address; sochn-sccurily number- and - ■ 

10 credit card information, personal preferences, behavioral information, history, and web site 
layout preferences. The Supplier's Web Server 1070 provides access to all of the supplier's 
databases necessary to provide information and trcinsiictionnl support to the customer. 

The Product Information Database 1080 stores alt product-related information, such as features, 
1 5 availability and pricing. The Product Order Database 1 090 stores all customer orders. The 

interface to this database may be through an Enterprise Resource Planning application offered by 
SAP, Baan, Oracle or others, or it may be accessible directly through the Supplier's Web Server 
or application server. The Customer Information Database 1091 stores all of the customer 
information that the supplier needs to complete a transaction or maintain customer records. 

20 

Figure 1 OB is a flowchart providing the logic utilized to create a web page within the Egocentric 
Interface. The environment assumes a web server and a web browser connected through y 
TCP/IP network, such as over the public Internet or a private Intranet. Possible web servers 
could include Microsoft Internet Information Server, Netscape Enterprise Server or Apache. 

25 Possible web browsers include Microsoft Internet Explorer or Netscape Navigator. The client 
(i.e. web browser) makes a request 1001 to the server (i.e. web server) for a particular web page. 
This is usually accomplished by a user clicking on a button or a link within a web page. The web 
server gets the layout and content preferences 1002 for that particular user, with the request to the 
database keyed off of a unique user id stored in the client (i.e. web browser) and Uie User profile 

30 database 1003. The web server then retrieves the content 1004 for the page that has been 

requested from the content database 1005. The relevant user-centric content, such as calendar, 

email, contact list, and task list items arc then retrieved 1006, (Sec Figure II Tor a more detailed 

description of this process.) The query to the database utilizes the user content preferences 

57 



PAGE 95/181 * RCVD AT 1114/2005 12:09:56 PM [Eastern Standard Time)* SVR:USPTO-EFXRF-1/28* DNIS:2734041 ■ CSID:8013281707* DURATION (mm-ss):63-28 



01/14/2005 10:49 FAX 8013281707 WORKMAN NYOEGGER ©096/181 

WO 00/54206 PCT/IBOO/00385 
stored as part of the user profile in the User profile database 1003 to filter the content that is 
returned. The content that is returned is then formatted into a web page 1007 according to the 
layout preferences defined in the user profile, The web page is then returned to the client and 
displayed to the user 1008. 

5 

Figure 1 J describes the process of retrieving user-centric content to add to a web page. This 
process describes 1006 in Figure 1 0B in a more detailed fashion. It assumes that the server 
already has obtained the user profile and the existing content thai is going to be integrated into 
this page. The server parses 1 1 10 the filtered content, looking-for instances of events, contact ~— 

10 names and email addresses. If any of these are found, they are tagged and stored in a temporary 
holding space. Then, the server tries to find any user-ceniric content 1 120 stored in various 
databases. This involves matching the tagged items in the temporary storage space with calendar 
items 1130 in the Calendar Database 1140; email items 1115 in the Email Database 1114; 
contact items 1117 in the Contact Database 1168; task list items 1 1 19 in the Task List Database 

15 1118; and news items 1121 in the News Database 1120. After retrieving any relevant user- 
centric content, it is compiled together and returned 1122. 

User Persona 

The system allows the user to create a number of different personam that aggregate profile 
information into sets that are useful in different contexts. A user may create one persona when 
20 making purchases for his home. This persona may contain his home address and may indicate 
that this user is looking to find a good bargain when shopping. The same user may create a 
second persona that can be used when he is in a work context. This persona may store the user's 
work address and may indicate that the user prefers certain vendors or works for a certain 



company that has a discount program in place. When shopping for work-related items, the user 
25 may use this persona. A persona may also contain rules and restrictions. For instance, the work 
persona may restrict the user to making airline reservations with only one travel agent and 
utilizing booking rules set up by his employer. 

Figure 12 describes the relationship between a user, his multiple personas and his multiple 

30 profiles. At ihe User Level is the User Profile 1200. This profile describes the user and his 

account information. There is one unique record in the database for each user who has an 

account Attached to each user are multiple Personas 1220, 1230 & 1240. These Personas are 
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used to group multiple Profiles into useful contexts. For instance* consider a user who lives in 
San Francisco and works in Palo Alto, but has a mountain cabin in Lake Tahoe. He has three 
different contexts in which he might be accessing his site. One context is work-related. The 
other two are home-life related, but in different locations. The user can create a Persona for 
5 Work 1220, a Persona for Home 1230, and a Persona for his cabin home 1240. i£ach Persona 

references a different General Profile 1250, 1260 and 1270 which contains the address for that 
location. Hence, there are three General Profiles, Each Persona also references one of two 
Travel Profiles. The user maintains a Work Travel Profile 1280 that contains all of the business 
rules related lo booking tickets and making reservations. This Profile may specify, for instance, 
1 0 that this person only travels in Business or First Class and his preferred airline is United Airlines. 
The Work Persona references this Work Travel Profile. The user may also maintain a Home 
Travel Profile 1290 that specifies that he prefers to travel in coach and wants to find non- 
refundable fairs, since they are generally cheaper. Both the Persona for Home and the Persona 
for the cabin home point to the Home Travel Profile. 

15 

Figure 13 describes the data model that supports the Persona concept. The user table 1310 
contains a record for each user who has an account in the system. This table contains a uscrname 
and a password 1320 as well as a unique identifier. Each user can have multiple Person as 1330, 
which act as containers for more specialized structures called Profiles 1340. Profiles contain the 

20 detailed personal information in Profile Field 1350 records. Attached to each Profile arc sets of 
Profile Restriction 1360 records. These each contain a Name 1370 and a Rule 1380, which 
define the restriction, The Poile is in the form of a pattern like (if x then y), which allows the 
Rule to be restricted to certain uses. An example Profile Restriction would be the rule that 
dictates that the user cannot book a flight on a certain airline contained in the list. This Profile 

25 Restriction could be contained in the "Travel" Profile of the "Work" Persona set up by the user's 
employer, for instance. Each Profile Field also contains a set of Permissions 1390 that are 
contained in that record. These permissions dictate who has what access rights to that particular 
Profile Field's information. 



30 Intention-Centric Interface 

Satisfying Customer Intentions, such as Planning for Retirement or Relocating requires a 

specialized interface. Customer Intentions require extensive planning and coordination across 

many areas, ranging from financial security, housing and transportation to healthcare, personal 
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and professional development, and entertainment, among others. Satisfying Intentions requires a 
network of complementary businesses, working across industries, to help meet consumers* 
needs. 

5 An Intention-Centric Interface is a user interface designed to help the user manage personal 
Intentions. At any given point, the interface content is customized to show only content that 
relates to that particular Intention. The Intention-Centric Interface allows the user to manage the 
process of satisfying thai particular Intention. This involves a scries of discrete steps and a set of 
content areas the user can access. At any point, the user can also switch the interface to manage 
10 a different Intention, and this act will change the content of the interface to include only lhal 
content which is relevant to the satisfaction of the newly selected Intention. 

Figure 14 provides a detailed description of the data model needed to support an Intention- 
Centric interface. Each User Persona 1410 (see Figure 13 for a more detailed description of the 

1 5 Persona data model.) has any number of active User Intentions 1420. Each active User Intention 
is given a Nickname 1430, which is the display name the user sees on the screen. Each active 
User Intention also contains a number of Data Fields 1440, which contain any user data collected 
throughout the interaction with the user. For instance, if the user had filled out a form on the 
screen and one of the fields was Social Security Number, the corresponding Data Field would 

20 contain Name = "SSN" 1450, Value = "999-99-9999" 1460. Each User Intention also keeps 

track of Intention Step 1470 completion status. The Completion 1480 field indicates whether the 
user has completed the step. Every User Intention is a user-specific version of a Generic 
Intention 1490, which is the default model for that Intention for all users. The Generic Intention 
is customized through Custom Rules 1411 and 1412 that are attached to the sub-steps in the 

25 Intention. These Custom Rules are patterns describing how the system will customize the 

Intention for each individual user using the individual user's profile information. 

Statistical Agent 

An agent keeps track of key statistics for each user. These statistics are used in a manner similar 

30 to the Tamagochi virtual reality pet toy to encourage certain behaviors from the user. The 

statistics that are recorded are frequency of login, frequency of rating of content such as news 

articles, and activity of agents, measured by the number of tasks which it performs in a certain 
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period. This information is used by the system to emotionally appeal to the user to encourage 
certain behaviors. 

Figure 15 describes the process for generating the page that displays the agent's current statistics. 
5 When the user requests the agent statistics page 1510 with the client browser, the server retrieves 
the users* statistics 1520 from the users' profile database 1530. The server (hen performs the 
mathematical calculations necessary to create a normalized set of statistics 1540. The server then 
retrieves the formulas 1550 from the content database 1560 thai will be used to calculate the 
user-centric statistics. Graphs are then generated 1570 using the generic formulas and' that User's 
10 statistics. These graphs are inserted into a template to create the statistics page 1580. This page 
is then returned lo the user 1590. 



Personalized Product Report Service 

The system provide Consumer Report-like service that is customized for each user based on a 
user profile. The system records and provides ratings from users about product quality and 
desirability on a number of dimensions. The difference between this system and traditional 
product quality measurement services is that the ratings that come back to the users are 
personalized. This service works by finding the people who have the closest match to the user's 
profile and have previously rated the product being asked for. Using this algorithm will help to 
ensure that the product reports sent back to the user only contain statistics from people who are 
similar to lhal user. 



Figure 16 describes the algorithm for determining the personalized product ratings for a user, 
wnen uie user requests a product report l610Yor product X, the algorithm retrieves the profiles - 
1620 from the profile database 1630 (which includes product ratings) of those users who have 
previously rated that product. Then the system retrieves the default thresholds 1640 for the 
profile matching algorithm from the content database 1650. It then maps all of the short list of 
users along several dimensions specified in the profile matching algorithm 1660. The lop n 
(specified previously as a threshold variable) nearest neighbors are then determined and a test is 
performed to decide if they arc within distance y (also specified previously as a threshold 
variable) of the user's profile in the set 1670 using the results from the profile matching 
algorithm. If they are not within the threshold, then the threshold variables are relaxed 1680, and 

61 



PAGE 99/181 * RCVD AT 1/14/2005 12:09:56 PM [Eastern Standard Time] * SVR:USPTO-EFXRM/28 * DNIS:2734041 * CS1D:801 3281 707 * DURATION (mm-ss):68-28 



10 



01/14/2005 10:50 FAX 8013281707 WORKMAN N VDEGGER ©100/181 

WO 00/54206 _ 

PCT/IB00/0Q385 

Ihc tcsi is run again. This processing is repealed until the'tcst returns true. The product ratings 
from the smaller set of n nearest neighbors are then used to determine a number of product 
statistics 1690 along several dimensions. Those statistics arc inserted into a product report 
template 1695 and relumed lo the user 1697 as a product report, 

5 Personal Profile and Services Ubiquity 

This system provides one central storage place for a person's profile. This storage place is a 
server available through the public Internet, accessible by any device that is connected to the 

Internet and has appropriate aceess. Because of the ubiquitous accessibility of theprofrte; 

numerous access devices can be used to customize services for the user based on his profile. For 
example, a merchant's web site can use this profile to provide personalized content to the user* 
A Personal Digiial Assistant (PDA) with Internet access can synchronize the person's calendar, 
email, contact list, task list and notes on the PDA with the version stored in the Internet site. 
This enables the person lo only have to maintain one version of this data in order to have it 
available whenever it is needed and in whatever formats it is needed. 

15 

Figure 37 presents the detailed logic associated with the many different methods for accessing 
this centrally stored profile. The profile database 1710 is the central storage place for the users* 
profile information. The profile gateway server 1720 receives all requests for profile 
information, whether from the user himself or merchants trying to provide a service to the user. 
20 The profile gateway server is responsible for ensuring that information is only given out when 
the profile owner specifically grants permission. Any device that can access the public Internet 
1730 over TCP/IP (a standard network communications protocol) is able to request information 
from the profile database via intelligent HTTP requests. Consumers will be able to gain access 



lo services from devices such as their televisions 1740, mobile phones, Smart Cards, gas meters, 
25 water meters, kitchen appliances, security systems, desktop computers, laptops, pocket 

organizers, PDAs, and their vehicles, among others. Likewise, merchants 1750 will be able lo 
access those profiles (given permission from the consumer who owns each profile), and will be 
able lo offer customized, personalized services to consumers because of this. 



One possible use of the ubiquitous profile is for a hotel chain. A consumer can carry a Smart 
Card that holds a digital certificate uniquely identifying him. This Smart Card's digital 
certificate has been issued by the system and it recorded his profile information into the profile 
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database. The consumer brings this card into a hotel chaiiTand checks in. The hotel employee 
swipes the Smart Card and the consumer enters his Pin number, unlocking the digital certificate. 
The certificate is sent to the profile gateway server (using a secure transmission protocol) and is 
authenticated. The hotel is then given access to a certain part of the consumer's profile that he 
5 has previously specified. The hotel can then retrieve all of the consumer's billing information as 
well as preferences for hotel room, etc. The hotel can also access the consumer's movie and 
dining preferences and offer customized menus for both of them. The hotel can offer to send an 
email to the consumer's spouse letting him/her know the person checked into the hotel and is 
safe, All transaction information can be uploaded to the consumer's profile after the hotel checks 
10 him in. This will allow partners of the hotel to utilize the information about the consumer that 
the hotel has gathered (again, given the consumer's permission). 

Intention Value Network 

In an Intention Value Network, the overall integrator system coordinates the delivery of products 
and services for a user. The integrator manages a network of approved suppliers providing 
15 products and services, both physical and virtual, to a user based on the user's preferences as 
reflected in the user's profile. The integrator manages the relationship between suppliers and 
consumers and coordinates the suppliers' fulfillment of consumers' intentions. It does this by 
providing the consumer with information about products and suppliers and offering objective 
advice, among other things. 

20 

Figure 18 discloses the detailed interaction between a consumer and the integrator involving one 
supplier. The user accesses a Web Browser 1810 and requests product and pricing information 
from Lhc integrator. The request is sent from the user's browser to the integrator's 
Web/ Application Server- t82fr~ T he use r 's pre ferences an d personal i nfouuutiu n is obtain ed f r om * - 

25 an integrator's customer profile database 1830 and returned to the Web/ Application server The 
requested product information is extracted from the supplier's product database 1840 and 
customized for the particular customer. The Wcb/Appli cation server updates the supplier's 
customer information database 1850 with the inquiry information about the customer. The 
product and pricing information is then formatted into a Web Page 1860 and returned to the 

30 customer's Web Browser. 
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Summary Agent # 

A suite of software agents running on the application and web servers are programmed to take 
care of repetitive or mundane tasks for the user. The agents work according to rules set up by the 
user and are only allowed to perform tasks explicitly defined by the user. The agents can take 
5 care of paying bills for Ihc user, Tillering content and emails, and providing a summary view or 
tasks and agent activity. The user interface for the agent can be modified to suit the particular 
user. 



Figure 19 discloses the logic in accordance with a preferred embodiment processing by an agent 
10 to generate a verbal summary for the user. When ihe user requests the summary page 1900, the 
server gels the user's agent preferences 1920, such as agent type, rules and summary level from 
the user profile database 1930. The server gets the content 1940, such as emails, to do list items, 
news, and bills, from the content database 1950. The agent parses all of this content, using the 
rules stored in the profile database, and summarizes the content 1960. The content is formatted 
15 into a web page 1970 according to a template. The text for ihc agent's speech is generated 1980, 
using the content from the content database 1990 and speech templates stored in the database. 
This speech tcxl is inserted into the web page 1WS ynd Ihe puge is returned lo ihe user 1*>S>7. 

Trusted Third Parly 

The above scenario requires the web site to maintain a guarantee of privacy of information 
20 according to a published policy. This system is the consumer's Trusted Third Party, acting on 
his behalf in every case, erring on the side of privacy or information, rather than on the side of 
stimulation of commerce opportunities. The Trusted Third Party has a set of processes in place 
that guarantee certain complicity with the stated policy. 

^ k nieC o"m m e r ce" 

25 This word extends the word "eCommerce" to mean "personalized electronic commerce." 

Figure 20 illustrates a display login in accordance with a preferred embodiment. The display is 
implemented as a Microsoft Internet Explorer application with an agent 2000 that guides a user 
through the process of interacting with the system to customize and personalize various system 
components to gather information and interact with the user's personal requirements. A user 

30 enters a usemamc at 2010 and a password at 2020 and selects a button 2040 to initiate the login 
procedure. As the logo 2030 suggests, the system transforms electronic commerce into a 
personalized, so called "me" commerce. 
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Figure 21 illustrates a managing daily logistics display in accordance with a preferred 
embodiment. A user is greeted by an animated agent 2100 with a personalized message 2190. 
The user can select from various activities based on requirements, including travel 2110, 
5 household chores 2120, finances 2130 and marketplace activities 2140. Icons 2142 for routine 
tasks such as c-mail, calendaring and document preparation are also provided to facilitate rapid 
navigation from one activity to another. Direct links 2146 are also provided to allow transfer of 
news and other items of interest. Various profiles can be selected based on where the user is 
located. For example, work, home or vacation. The profiles can "Be added 2170 a 4 s a user 
10 requires a new profile for another location. Various items 2180 of personal information are 
collected from the user to support various endeavors. Moreover, permissions 2150 arc set for 
items 2180 to assure information is timely and current 

Figure 22 illustrates a user main display in accordance with a preferred embodiment. World 
15 2200 and local news 2210 is provided based on a user's preference. The user has also selected 

real estate 2230 as an item to provide direct information on the main display. Also, a different 
agent 2220 is provided based on the user's preference. 

Figure 23 illustrates an agent interaction in accordance with a preferred embodiment. The agent 
20 2310 is communicating information 2300 to a user indicating that the user's life insurance needs 
have changed and pointing the user to the chart that best summarizes the information for the user. 
Particular tips 2395 are provided to facilitate more detailed information based on current user 
statistics. A chart 2370 of the user's life insurance needs is also highlighted at the center of the 
display to assist the user in determining appropriate action. A button 2380 is provided to 
25 facilitate changing the policy and a set of buttons 2390 are provided to assist a user in selecting 

various views of the user's insurance requirements. 

Event Backgrounder 

An Event Backgrounder is a short description of an upcoming event that is sent to the user just 

before an event. The Event Backgrounder is constantly updated with the latest information 

30 rclaLcd to this event. Pertinent information such as itinerary and logistics arc included* and other 

useful information, such as people the user knows who might be in the same location, are also 

included. The purpose of the Event Backgrounder is to provide the most up-to-date information 
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about an event, drawing from a number of resources, suchTas public web sites and the user's 
calendar and contact lists, to allow the user to react optimally in a given situation. 

Vicinity Friend Finder 

This software looks for opportunities to tell the user when a friend, family member or 
5 acquaintance is or is going to be in the same vicinity as the user. This software scans the user's 
calendar for upcoming events. It then uses a geographic map to compare those calendar events 
with the calendar events of people who are listed in his contact list. It then informs the user of 
any matches, thus telling the user that someone' is scheduled to be near him at -a particular lime, - 

10 Information Overload 

The term information overload is now relatively understood in both its definition as well as its 
implications and consequences. People have a finite amount of attention that is available at any 
one lime, but there is more and more vying for that attention every day. In short, too much 
information and too little time arc the primary factors complicating the lives of most knowledge 

15 workers today. 

The first attempts to dynamically deal with information overload were primarily focused on the 
intelligent filtering of information such that the quantity of information would be lessened. 
Rather than simply removing random bits of information, however, most of these approaches 
20 tried to be intelligent about what information was ultimately presented to the user. This was 

accomplished by evaluating each document based on the user's interests and discarding the less 
relevant ones. It follows, therefore, that the quality was also increased. 

Fillering the information is only a first step in dealing with information is this new age. 

25 Arguably, just as important as the quality of the document is having ready access to it. Once you 
have entered a meeting, a document containing critical information about the meeting subject 
delivered to your office is of little value. As the speed of business continues to increase fueled 
by the technologies of interconnectedness, the ability to receive quality information wherever 
and whenever you arc becomes critical. This new approach is called intelligent information 

30 delivery and is heralding in a new information age. 
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A preferred embodiment demonstrates the intelligent information delivery theory described 
above in an attempt to not only reduce information overload, but to deliver high quality 
information where and when users' require it. In other words, the system delivers right 
information to the right person at the right time and the right place. 

5 

Active Knowledge Management System Description 

Figure 24 is a block diagram of an active knowledge management system in accordance with a 
preferred embodiment. The system consists of the following parts: back-end 2400 connection to 
one or more servers, personal mobile wireless clients (Awareness Machinc)2430, 2436, public 
10 clients (Magic Wall) 2410, 2420, web clients 2446, 2448, e-mail clients 2450, 2460. 

Buck-end Server (2400) Processes 

Figure 25 is a block diagram of a back end server in accordance with a preferred embodiment. 
The back-end (2400 of Figure 24) is a computer system that has the following software active: 
15 Intelligent Agents Coordinator (Munin) 2580, Information Prioritization Subsystem 2530, a set 

of continuously and periodically running information gathering and processing Intelligent Agents 
2500, 2502 and 2504, User Profiles Database 2542 and supporting software, Information 
Channels Database 2542 and supporting software, communications software 2550, information 
transformation software 2560, and auxiliary software. 



20 



The Awareness Machine (2446 & 244S of Figure 24) 

• The Awareness Machine is a combination of hardware device and software application. The 
hardware consists of handheld personal computer and wireless communications device. The 



Awareness Machine reflects a constantly updated statc-of-thc-owner's-world by continually 
25 receiving a wireless trickle of information. This information, mined and processed by u suite 

of intelligent agents, consists of mail messages, news that meets each user's preferences, 
schedule updates, background information on upcoming meetings and events, as well as 
weather and traffic. 

30 The Intelligent Agent Coordinator 2580 of Figure 25 is also the user's "interface" to the system, 

in that whenever the user interacts with the system, regardless of the GUI or other end-user 

interface, they are ultimately dealing with (asking questions of or sending commands to) the 

67 



PAGE 105/181 1 RCVD AT 1/14/2005 12:09:56 PM [Eastern Standard Time] * SVR:USPTO-EFXRF-1/28 * DN1S:2734041 * CSID:8013281707 < DURATION (mn>ss):68-28 



01/14/2005 



10:53 FAX 8013281707 



WORKMAN N YDEGGER 



® 106/181 



WO 00/54206 PCT/1B00/00385 
Intelligent Agent Coordinator, The Intelligent Agent Coordinator has four primary 
responsibilities: 1) monitoring user activities, 2) handling information requests, 3) maintaining 
each user's profile, and 4) routing information to and from users and to and from the other 
respective agents. 

5 Monitoring User Activates 

Anytime a user triggers a sensor the Intelligent Agent Coordinator receives an "environmental 
cue." These cues not only enable the Intelligent Agent Coordinator to gain an understanding 
where users' arc for information delivery purposes, but also to learn the standard patterns (arrival 
time, departure time, etc,) of each persons' life. These patterns are constantly being updated and 

1 0 refined in an attempt to increase the system's intelligence when delivering information- For 

instance, today it is not uncommon for a person to have several email accounts (work-based, 
home-based, mobile-based, etc.) as well as several different computers involved in the retrieval 
process for all of these accounts. Thus, for the Intelligent Agent Coordinator to be successful in 
delivering information to the correct location it must take into account all of these accounts and 

1 5 the times that the user is likely to be accessing them in order to maximize the probability that the 

user will see the information. This will be discussed further in another section. 

Handling Information Requests 

The Intelligent Agent Coordinator handles information requests from other agents in order to 
personalize information intended for each user and to more accurately reflect each user's interests 

20 in the in formal ion they arc given. These requests will commonly be rcluicd to the user's profile. 

For instance, if an agent was preparing a traffic report for a user it may request the traffic region 
(search string) of that user from the Intelligent Agent Coordinator. All access to the user's 

profil e d ata is accessed in this method- 

M ain tabling User Profiles 

25 User profiles contain extensive information about the users. This information is a blend of user- 
specificd data and information that the Intelligent Agent Coordinator has learned and 
extrapolated from each user's information and activities, tn order to protect the data contained in 
the profiles, the Intelligent Agent Coordinator must handle all user information requests. The 
Intelligent Agent Coordinator is constantly modifying and updating these profiles by watching 

30 the user's activities and attempting to learn the patterns of their lives in order to assist in the 
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more routine, mundane tasks. The Intelligent Agent Coordinator also employs other agents to 
glean meaning from each user's daily activities. These agents mine this data trying to discover 
indications of current interests, long-term interests, as well as time delivery preferences for each 
type of information. Another important aspect of the Intelligent Agent Coordinator's 
S observations is that it also tries to determine where each user is physically located throughout the 
day for routing purposes. 

Information Routing 

Most people are mobile throughout theirday; -The-hrtclKgent Agent Coordinator tries to be 
sensitive to this fact by attempting to determine, both by observation (unsupervised learning) and 

10 from cues from the environment, where users arc or arc likely io be located. This is certainly 

important for determining where to send the user's information, but also for determining in 
which format to send ihe information. For instance, if a user were at her desk and using the web 
client, the Intelligent Agent Coordinator would be receiving indications of activity from her PC 
and would know to send any necessary information there. In addition, because desktop PCs are 

15 generally quite powerful, a full-featured, graphically intense version could be sent. However, 

consider an alternative situation: the Intelligent Agent Coordinator has received an indication 
(via the keycard reader next to the exit) that you have just left the building. Minutes later the 
huclligcnl Agent Coordinator also receives noli Heat ion Unit you have received an urgent 
message. The Intelligent Agent Coordinator, knowing that you have lefl the building and having 

20 not received any other indications, assumes thai you arc reachable via your handheld device (for 
which it also knows the capabilities) and sends the text of the urgent message there, rather than a 
more graphically-oriented version. 

Inherent Innovations ~ : 

25 The Active Knowledge Management system represents some of the most advanced thinking in 
the world of knowledge management and human computer interaction. Some of the primary 
innovations include the following: 

• The Intelligent Agent Coordinator as illustrated above. 

• The development, demonstration, and realization of the theory of Intelligent Information 
30 Delivery 

• Support for several channels of information delivery, all of which utilize a common back- 
end. For instance, if a user is in front of a Magic Wall the information will be presented in a 
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multimedia-rich form. If the system determines that ttfe user is mobile, the information will 
be sent by to their Awareness Machine in standard text. It facilitates delivery of information 
whenever and wherever a user requires the information. 

• Personalization of information based not only on a static user profile, but also by taking into 
5 account history of the user interactions and current real-time situation including "who, where, 

and when" awareness. 

• Utilization of fast and scalable Information Prioritization Subsystem that takes into account 
Intelligent Agents Coordinator opinion, user preferences, and history of user interactions. It 
takes the load of mundane decisions off the Intelligent Agents part therefore*allowing the 

1° agents to be much more sophisticated and precise without compromising the system 

scalability. 

• Speech recognition and speech synthesis in combination with intelligent agent animated 
representation and tactile input provides for efficient, intuitive, and emotionally rewarding 
interaction with the system. 

15 

Client Reporting Subsystem Model 

Context 

The Reporting subsystem is used by other subsystems on the client to report (read: make a matter 
of record) various data. The subsystem makes no assumptions about the type of data it handles - 
20 [lie daia could be fault reports (as part of an architectural service) or lead management 

information (as part of an application data service). The Reporting subsystem is in this sense 
part of the infrastructure, it is an underlying set of services available everywhere on the client. 
The Reporting subsystem uses the Communications subsystem to store and forward data. 

Architecture Overview 

25 The Reporting subsystem offers services to every client subsystem. It comprises a mechanism 
for messaging within the client application and between the client and the server. 

The Reporting mechanism uses the Communications subsystem to store and forward data. The 
Exceptions use this Reporting mechanism for reporting information about errors only. 
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Role 

The Reporting subsystem provides a set of infrastructural services which allow architectural 
components to report information. The subsystem makes no stipulation about the information 
reported, although it does contain components that map to certain types of reported information, 
5 such as system faults or customer interaction information. 

Part of the subsystem interface is presented as a set of Exceptions, which allow the automatic 
reporting of error conditions encountered during processing. 

The subsystem accepts data and forwards it in an appropriate format to the Communications 
10 subsystem. It is captures and reports Exceptions generated during processing that are the result 
of error conditions. It is able to deal with any type of report that needs to be made, from error 
logging to sales leads. It is flexible enough to record new types of information as required. It is 
also flexible enough to be able to add new types of report as required. In addition, it is able to 
deal with the non-availability of certain information during the logging process. 

1 5 Responsibilities 

The Client Reporting Subsystem is responsible for providing a set of Exceptions for use by all 
parts of the application. The Subsystem is also responsible for logging fault reports, user 
interaction reports, application heartbeat reports, message receipts, referrals or leads, and 
Management Information System entries. 

20 Exclusions 

The subsystem is not responsible for gathering information from interface interactions or 
elsewhere; neither is it responsible for deciding what of a set of data needs to be reported. 
Reporting docs not include thu priutiug-of reports. 

Component Specifications 

Client Exception This is a set of Exception classes which, using 
Reporting the Client Reporting Component reporting 

Component services, stores and sends fault information 

Client Reporting This is the mechanism by which information for 
Component all reports are collected, formatted, and 

submitted to the Client Communications 

Subsystem. 
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Creation, Existence, and Management 

The key element of the subsystem is a static class which manages the creation of report objects - 
a report factory. This class is instantiated by the Communications subsystem (which manages 
5 client configuration) and is always available. It is a severe error if it is not. Reports are generated 
on an ad hoc basis as needed. 

Sizing and Capacity 

Whatever the requirements of the client architecture, the 'throughput' of the Client Reporting 
subsystem (understood as the number of reports, of every type, thai arc requested in a given lime) 
10 will not place significant strain on system resources. Most of the capacity requirements for 

reports are absorbed by the Communications subsystem, which must arrange for the storage and 
transmission of those reports. 

Nevertheless, the subsystem must be able 10 deal with whatever throughput is demanded by the 
architecture, and the design lakes- into consideration the estimated workload generated by each 
15 part of the architecture. 

Performance 

Performance is not critical for the Client Reporting subsystem. Reported data, with a few 
exceptions, is stored before transmission, and so a delay before data is sent is anticipated. 



20 



Certain types of severe or critical faulis need to be reported at once, but the low bandwidth 
required for these transmissions will not present performance problems. 



Design Guideline* 



25 



The reporting needs of the architecture fluctuate, although a core set of capabilities (fault 
reporting, lead management, interaction reporting) always remain requirements. The subsystem 
is flexible enough not only lo extend or reduce its capabilities, but also to adjust the level of 
detail and the nature of data it records for each capability. 
Implementation of the system follows the project Java coding standards. 
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Logical Components 

Exceptions within the Client Exception Reporting component call the Client Reporting 
component to create fault reports. 



Component Descriptions 



Client Exception 
Component 



Client Reporting 
Component 



This is a hierarchy of Exception classes 
structured to assist in the handling and passing 
of Exceptions. -These Exceptions will accept ■■■■ 
information about the Exception event they 
represent. With this information and whatever 
else the class knows about it's own event, (he 
component will use the Client Reporting 
Component to create fault reports. 
A static report factory will accept requests from 
other components in the form of a signalled 
event. Based on this event, the factory will 
manufacture a report of a certain type. The 
report will then be populated with information 
supplied by the calling component or reporter. 



Submitting a Report 

10 Component A signals the Client Reporting subsystem to indicate that a reportable event has 

occurred. The Client Reporting subsystem then requests information about the event and creates 
a report. Finally, the Client Reporting subsystem signals to the Client Communication subsystem 
that the report is ready to be "seftC 

Throwing an Exception 

15 First, Component A signals that an exceptional event has occurred by instantiating an appropriate 
Exception. Second, Component A passes reportable event relevant information to the Exception. 
Third, Component A requests for the Exception to be thrown. Fourth, the Client Exception 
Reporting component submits a report to be sent based on the information available using (he 
Client Reporting component as outlined above. Finally, the Client Exception Reporting 

20 component throws it's Exception. 
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Local Content Subsystem Model 

Context 

5 The Local Content subsystem provides all content required by the application. This includes 
both static and dynamic content. It also provides business services required by the application. 
It operates on a "storage and retrieval" basis, storing the data obtained from the user and the 
business, and providing mechanisms to retrieve that data. The Local Content subsystem is used 
by the ISF subsystem to provide content. It uses the Communication subsystem to receive 
10 business data. 

Architecture Overview 

Objects in the Local Content subsystem are created by the Initialisation subsystem of the 
Application Architecture, Services provided by the Local Content subsystem arc also accessed 
through the Application Architecture, via the Initialization and ISF subsystems. 

15 

The example components of the Local Content subsystem reflect different types of business 
knowledge and processes required by the application. User Data and Business Data involve data 
collected respectively from the user and the business. The Calculation component performs 
complex calculations, and the Product component represents the products used by the business. 
20 . The Content Providers component defines static media content. 

Role 

The Local Content subsystem provides static and dynamic content to the application. It also 
provides all business-specific services required by the application, 

25 Responsibilities 

The Local Content subsystem provides static and dynamic media to the application. The Local 
Content subsystem also stores store user entered details, business data, and performs business 
calculations. 
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♦ 

Exclusions 

All application-specific behaviour is provided through the Application Personality. This 
behaviour is defined by Hamlet scripts, which also define navigation between scripts. The 
scripts are divided into metaphors, each of which is an embodiment of a style of interaction. 

5 

Access to media is provided through the Content Providers component, which belongs to this 
subsystem. However, the objects of this component arc created automatically by the System 
Initialiser component from a contents file defined in the Application Personality- 

10 Creation, Existence, and Management 

The Business Data component is created and initialized at the time of System Initialization* It 
exist for the life of the system. 

The User Data component is available Tor the entire Lime a customer is using the system. When a 
15 customer session ends, references to all objects in the User Data component are released so that 

Lhe objects can be garbage collected. 

Objects in the Local Content subsystem (with the exception of the Business Data Component) 
arc created and initialized either internally or by the Initialization subsystem. References to these 
20 objecis are managed by the ISF subsystem. Business Data objects are created, initialized and 
managed by the Communications subsystem. 

Lo gical Comp onents . 

25 The ISF does not actually know about the Local Content subsystem. The Local Content v 

subsystem implements a set of interfaces defined by the ISF. The Initialization subsystem uses 
the scripts defined in the Application Personality to define which objects (implementing those 
interfaces) need to be used to retrieve content. The ISF uses the Initialization component to 
create those objects, then manages them. 

30 
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Developers of the Application Personality can easily view'thcir scripts as directly managing the 
local content objects. This allows the local content objects to be developed without knowledge 
of the Application Architecture layer. 

Componen t Descriptions 

5 

User Data Stores and retrieves data entered by the user, and 
initiates calculations on stored data, 
Business Data Stores and retrieves data provided by the 
business. 

Calculation Performs complex calculations. 

Product Provides access to information associated with 

particular marketing products. 
Content Provides access to static media. This is an 
Providers implementation of an interface and is not 
documented as a separate component. 

Interface Support Framework Subsystem Model 

Context 

The Interface Support Framework subsystem is part of ihc Application Architecture Layer. It 
1 0 provides a rich interactive environment which exploits the full potential of a dynamic, multi- 

media interface. The ISF is built around a theatrical metaphor where every object is expected to 
exert dynamic behavior. 

Objects within the ISF are initialized by the Application Initialization subsystem within the 
15 Application Architecture Layer and utilize the services of the Content Players, Printing and 
Reporting subsystems in the Technical Architecture Layer. 



Architecture Overview 

Objects within the ISF subsystem are initialized by the Application Initialization Subsystem. 
20 Reporting and Transaction Interface Services are used to log ISF data for the Technical 
Architecture layer to report or print. The Content Player subsystem within the Technical 
Architecture is used by the ISF to present media to the user. 
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The 1SF subsystem is built upon a layered architecture which follows the Model-View-Conlrollcr 
pattern. The Factual component contains the object model of the business and definitions of 
business media content. The Visual component displays and manipulates media to provide a 
view of the business model to the user. The Behavioral component controls all interactions 
5 between the Visual and Factual components. 



Role 

The ISF subsystem provides the services for the application tp present multimedia content in a. 
controlled way. It also provides the capability to react to user input and affect changes to the 
10 scene. 

Responsibilities 

The ISF subsystem displays each scene of the application, and modifies the content of a scene 
while it is displayed. In addition, the ISF subsystem enables navigation between scenes, reacts to 
user interaction, retrieves business content, performs business functions and calculations, and 
15 provides common user interface constructs. Other responsibilities of the ISF include initiating 
print jobs and video conference sessions, reporting on user entry into a scene, duration of a 
session, user interaction with a role, user navigation, and reporting on errors occurring within the 
ISF. Finally, the ISF manages user sessions, and responds to system level events such as system 
start up and shutdown or screen paint requests. 

20 Design Guidelines 

The ISF subsystem provides the services for the application to present multimedia content. It is 
- -a rchit ec tura l ly la yer ed i n to t hre e d i st in ct co mponent s which parallel the Model-View-Controller 
paradigm. This separates the core business objects and their data (the Model), from the visual 
representation of this information (the View), from the logic to control and react to changes in 
25 the Model or the View (the Controller). The architecture provides boundaries between the 
graphical style of the system (Stage, Roles and Scenes), the operational code (Actors, Scene 
Director and Stage Manager), and the underlying Content Providers (Business Objects). These 
sections are the Visual, the Behavioral, and the Factual components. 
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The Factual Layer is nol aware of the Visual layer. This uflows the visual metaphor to change, 
without disrupting the underlying business domain model The Behavioral level mediates 
between the Factual and visual layers and should avoid veiy complex interactions with either 
layer, Where possible, anonymous communications via a Publish/Subscribe pattern is used to 
avoid further interdependences between the layers. 



10 



15 



The Stage is identified as the display context It is able to communicate only with the Locations 
it controls. It is hidden behind the StageManager, where all visual requests need to be managed. 

The ISF is a layered system. All roles in a scene form a series of visual siblings. These roles 
can, in fact, contain and encapsulate other roles. This allows, through recursion, any number of 
distinct processing layers. Each child only communicates with its direct parent, surrendering 
Control of communicating beyond to the parent. This containment relationship is possible in 
both the Visual and Behavioral layers. 

To assist in navigation, Scene Thumbnails are maintained. The user may touch on a Scene 
Thumbnail to return to a previously visited Scene, 

Component Descriptions 



Visual component user interaction and presentation of multimedia 
content 

Behavioral application behavior and multimedia content 

component retrieval 

Factual component provides multimedia content and business 
function services and calculations 



20 Process Control 

This table describes the various key threads which execute within the ISF, 



Thread 


Purpose 


AWT 


Sends windows messages (e.g. screen touches) to 
the ProcessControllcr. This thread is created by 
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the Java Virtual Machine. 


JYLalJj 


initializes me application, men exits, 1 nis tnre&G 
is created by the Java Virtual Machine, 


r rocessing 


±*errorms me actions in jiiaLea oy tne 
ProcessControl ler. 


Timer 


Generates and actions time based system events 
such as session timeouts. 


video otaius 


Receives notification of video finish events and 
dispatches them to the ProccssCoiilrollcr. 


Audio Status 


Receives notification of audio finish evcnLs and 
dispatches them to the ProcessController. 



User touches Location on Stage 
Description: 

End users will touch the visible window of the application, the Stage, This will initiate a 
response from the application. 
5 Actors: 
End user 

Components Involved; 
Visual 

Key Objects Involved: 

10 Stage 

Stage processes User Touch 
Description: 

The application window will determine which location is affected by the touched area, and will 
notify the corresponding Role of a touch. The stage will also control the visual cue displayed on 
1 5 the window. 
Actors: 
End user 
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Components Involved: 
Visual 

Key Objects Involved; 

Timer, User Interaction Reporter, Location, Media Player 

5 Role accepts User Touch Event 
Description: 

Each role is notified of a user touch. This will force it to request a media change in its 
corresponding media, and, once accomplished, to notify its actor ofthc user interaction. 
Actors: 
10 Stage 

Components Involved: 
Visual, Behavioral 
Key Objects Involved: 
Actor, Role 

15 

Actor activates Event Casting 
Description: 

The actor will cycle through all of its registered Casting Lists and activate all castings which are 
interested in the specific event. Castings bchuvc polyniorphically, and therefore the behaviour of 
20 how to respond is actually held in the Casting, not the actor. 
Actors: 

Role, Execute Casting 
Components Involved: 
Behavioral 
25 Key Objects Involved: 

Actor, Casting, Stage Manager, Scene Director 



Stage Manager performs Scene Transition 
Description: 
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The Stage Manager will replace the currently active scene with a hew scene, based on the 
information in the Navigation Casting, It is important to control how the change occurs, to 
preserve the visual illusion of the Kiosk World. 

This scenario is also invoked when starting, or restarting, the application* In this case, there is no 
5 current Scene, but the application is told to transition to the first Scene of the application- 
Acton 

Navigation Casting, System Initializer 
Components Involved: 
Behavioral, Visual 
10 Key Objects Involved: 

Stage, Scene Director, Session Manager 

Scene Director performs Cast Change 
Description: 

The Scene Director coordinates the activation of all timings to ensure that any messages to the 
15 Stage Manager are grouped together and engaged at an appropriate time. This will ensure that all 
changes to the Roles visible on the scene will occur at the same time. 
Actors: 

Content Casting, Slide Casting 
Components Involved: 
20 Visual, Behavioral 

Key Objects Involved: 

Scene Director, Stage Manager 

Scene Director pe rforms Cast Change wit h Slide Effect 

Description: 

25 The Scene Director must onstage all non-sliding Roles and then display the content of the Slide 

Casting along a straight line until its final destination. 

Actors: 

Slide Casting 

Components Involved: 
30 Visual, Behavioral 
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Business Object invokes Business Function 
Description; 

The application may request business information from the Business Domain Model (e.g. return 
a Repayment Amount), This interface also supports putting values into the business objects (such 
5 as store a Loan Term Amount). Each business object is provided a generic interface to invoke 

behaviors. The desired behaviour is specified in the Business Function Casting, and it capable of 
returning information to the Actor associated with the Business Object 
Actors: Business Function Casting 
Components Involved: Factual 

1 0 Stage Manager times out from inactivity 
Description: 

The application must support a time out facility, in the event that the user walks away from the 
application prior to returning to the Attractor Screen. This will protect the privacy of details 
entered by users, 
15 Actors: Wait Timer 

Components Involved: Behavioral 

Session Manager resets application 

Description: 

During the execution of the application, it may be necessary to reset the Stage to the first scene, 
20 and clear out the session. This may be triggered by system inactivity, or by direct user request 
dispatched through a business object. 
Actors: Stage Manager's Wait Timer, Business Object 
Components Involved: Behavioral 



Heset Session information 
25 Description: 

Each session stores information gathered about the user. Ai the end ofa session, or by user 
request, it is possible to erase all entered data. This supports privacy, 
Actors: Session Miinsigcr 
Components Involved: Behavioral 

30 
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* 

Responsive Media displays media 
Description: 

The Visual component of the ISF is responsible for displaying all media (image, audio, video, 
text) to the Stage. It actually interfaces with the underlying media subsystem in the Client 
5 Technical Architecture. Each player is obtained through the Gatekeeper, and supports all code 

required to present the media to the user 
Actors: Role 

Components Involved: Visual, Behavioral, Factual, Content Players 
Key Objects Involved: Responsive Media, Media* Player, Stage 

10 

Application requests hard copy printout 
Description: 

The client application may request a print out of static information (check list), or dynamic 
information (product explanation including current interest rates and other dynamic components 
1 5 of the product, product simulation and/or line graph). This is initiated by the end user, through a 

Print Casting. 

Actors: Print Casting 

Components Involved: Behavioral, Printing 
20 Key Objects Involved: Business Object 

Reporting Interface Subsystem Model 

Context 

The Reporting Interface Subsystem collects information logged by the Application Architecture 
25 Layer and sends it to the Client Reporting Subsystem in the Technical Architecture Layer. 

Architecture Overview 

The Reporting Interface information is logged by components within the Application 
Architecture Layer and sent to the Client Reporting Subsystem in the Technical Architecture 
Layer. 

30 
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Role 

The Reporting Interface subsystem provides services to log user-interaction with the kiosk and 
report on software and hardware faults which occur within the Application Architecture Layer. 



5 Responsibilities 

The Reporting Interface subsystem is responsible for gathering and logging user interaction with 
the kiosk by capturing what a user is doing with the system, e.g. which scenes they arc visiting, 
which visual elements ihcy arc interacting with. The Reporting Interface subsystem also Gathers 
and logs information related to business products which the customer is interested in, the output 
10 of business functions which the customer has invoked and business data which the customer has 
input. Finally, the Reporting Interface subsystem captures information relating to the software 
and hardware performance of the kiosk. This information can then be used for error handling 
and fault management analysis. 

1 5 Exclusions 

The Reporting Interface subsystem does not include services to gather and log customer related 
information such as the a customer name and telephone numbers. 

Systems Management Subsystem Model 

20 Context 

Systems Management involves the definition of a combination of automated and manual 
procedures. Automation is achieved primarily through the use of Systems Management Server 
(SMS). SMS is a tool within the Microsoft backbflice suflc of tools which can centrally manage 
system software and hardware in a distributed environment. 

25 

Systems Management Subsystem architecture 

The Systems Management Subsystem architecture consists of two components, the Systems 
Management Server (SMS), and Fault Monitoring. 



30 Systems Management Server (SMS) 
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Systems Management Server (SMS) is a Microsoft tool that can be used to distribute software / 
content, take software audits, perform fault diagnosis and take remote control, SMS is 
supplemented by a component developed for the architecture, namely the File Transfer Utility. 

5 Fault Monitoring 

The Kiosk is monitored real-time through a Heartbeat message system. Heartbeat pulses are sent 
from the Kiosk at a configurable rate (say one every minute) and are monitored at a console 
running the Kiosk Monitoring Application. If the status of a Kiosk changes to indicate a fault, 
monitoring application will initiate the appropriate action. Some errors will be "handled through 
10 the existing Operations Centre. The routing of these errors is covered in the Application Services 
Subsystem. 

Role 

SMS is used for medium sized software distribution (both code and content) and for fault 
15 diagnosis of the remote kiosks. There are a large number of features that make SMS a flexible 
and useful support facility. Fault monitoring will provide the means to view the real-time status 
of each kiosk and associated peripherals. When a problem occurs at a particular kiosk (such as 
running out of paper), the kiosk will be brought to the attention of a operations representative. It 
will be possible to observe the kiosk status to verify the resolution of the problem. 

20 

Responsibilities 

The SMS is responsible for software distribution, hardware fault management and diagnosis, and 
client remote re-boots. The SMS also provides a user interface to selectively view the status of 
all kiosks in the network. 

25 Creation, Existence, and Management 

The SMS resides on a dedicated server in accordance with a preferred embodiment and is 
available at all times. 
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Performance * 

The elapsed time between a fault occulting on an MMT and subsequently being displayed to 
operations is dependent upon Ihc frequency ofthc heartbeat, the ability Tor the application server 
to process the heartbeat and the frequency of refresh on the operations terminal. 
5 An example in accordance with a preferred embodiment is presented below. 





Elapsed 

Time 
(minutes) 


A fault occurs immediately after a 
heartbeat message is sent. 


1:00 


The Heartbeat message is sent to the 
Application Server 


0:01 


The Application Server receives and 
n roc esses tHe heartbeat Trip^ao-e 


0:01 


The operations Fault Monitoring 
Application has just refreshed and is only 
refreshing once every 2 minutes. 


2:00 


The Fault Monitoring Application 
refreshes it's kiosk status main window 


0:05 


The Fault Monitoring Application 
refreshes it's kiosk status view (This time 
is for only one view window open. If 
there are more than one view windows 
open this time should be multiplied by 


0:05 


the number of open view windows) 




Total 


3:11 



If a heartbeat message is not received from a kiosk within five minutes, (configurable) the Fault 
monitoring will set the kiosk status to Unknown. This time lag is required to avoid erroneously 
reporting MMT machines as unknown when the real problem lies in a slightly slower than 
10 normal processing of a heartbeat message. 
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Logical Components * 

An SMS site comprises of two components - a Primary Site and Clients. A primary site is the top 
most level in the SMS hierarchy. It contains its own SQL database to store system and inventory 
information for itself and other secondary sites underneath it. Clients (kiosks) are administered 
5 from the primary site. The client sends its hardware/software information lo SMS server 

through the SMS Inventory service. 



Fault Monitoring 

After a configurable time interval the Client takes a status check of the Machine, Printer and the 
1 0 Application and sends it to the server in a heartbeat message. The server then places the status 
into a Kiosk Status Database that is monitored by operations staff for faults. 

Server Communications Subsystem Model 

Context 

15 The Server Communications subsystem is part of the Server Technical Architecture. 

The Server Communications subsystem handles all communications between clients, the central 
server, and the mainframe host. 



Architecture Overview 

20 The Asynchronous Messaging component provides ihe asynchronous message based 

communication between the client and the server, using standard Internet mail protocols, SMTP 
and POP3. 

The Business Process Access Module component provides the common point to invoke 
25 predefined business functionality such recording interaction information from the MMT, HTTP 
is the protocol used lo communicate with HTTP servers on the World Wide Web. It is used in Ihc 
MMT to distribute small updates of application components and content during the client 
configuration process on start-up. Access lo mainframe database resident data is done by 
replicating the required database tables to corresponding server resident database tables. The 
30 reverse process is used to centrally store the data accumulated on the server to the mainframe 
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database tables, Generic alerts from the server are transmitted to the mainframe through an 
interface to the mainframe's front end processor. 

Role 

5 The role of the Server Communications subsystem is to Provide the server with communications 
facilities between the MMT (or Internet) client and the network server and between the network 
server and the mainframe systems, In addition, the Server Communication subsystem isolates 
and provides access to organization specific functionality. 

1 0 Responsibilities 

The Server Communication subsystem complies with standard Internet protocols, to allow case 
ofponing to thai delivery channel. In addition, The Server Communication subsystem provides 
reliable asynchronous communication between the client and the application server, and 
controlled and reliable access to organization specific functionality. Finally, the Server 
15 Communication subsystem provides a facility to deliver updates to the configuration of the 
client, such as application components and content, and provides access to the organization's 
legacy systems through predefined processes, such as database replication and generic alert 
reporting. 

20 Exclusions 

Server Communication is confined to invoking modules which conform to the ACT messaging 
architecture. If communication to another platform is required, this must be located within the 
external systems module using the organizations messaging or access methods. 

25 Transaction Interface Subsystem Model 

Architecture Overview 

Transactions are initiated by components within the Application Architecture Layer and sent to 
the Client Reporting Subsystem in the Technical Architecture Layer. 
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The Transaction services identified in this document arc not implemented as separate 
components in their own right, but are implemented as extensions to existing Application 
Architecture components. 

5 Role 

The Transaction Interface subsystem is responsible for providing an interface to the application 
for storing of contact information about the end-user. These include, but arc not limited to 
information required to complete a loan, survey-based information on customer demographics, 
account balance inquiry, and funds transfer. 

10 

Customer Lead Transaction Execution 

The customer lead transaction execution application facilitates the Interface Support Framework 
and enables the services of the Reporting Subsystem of the Technical Architecture to support the 
gathering and storing of information about the end-user. 

Exclusions 

The current usage of the Transaction Interface assumes that only asynchronous communications 
arc available. 



Server Application Services Subsystem Model 

A rch it act arc O vervie w 

The Application Services Sub-system includes a set of definitions for building the MMT server 
application and architecture modules. 

Role 

The Server Application Services sub-system includes the set of services and definitions for 
accessing application and architecture functionality. This subsystem defines the structure and 
support services for building and executing applications and modules on the Application Server 
or Operations workstation platform. The functionality supported includes transaction processing t 
to/from the MMT: such as customer referral information, customer interaction information, MIS 
information, fault information, product rates and prices information, application configuration 
information, message receipt information, and heartbeat status information, 
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Responsibilities 

The Server Application Services sub-system processes application business logic on the server 
independently from the underlying database management system. The application business logic 
5 includes customer referral information, customer interaction information, MTS information, faull 

information, product rates and prices information, application configuration information, 
message reccipl information, and heartbeat status information. 

The Server Application Services sub-system also provides a common service available to all 
1 0 server and client applications to log an error, decode a given code (for example '] 7 = NSW, 4 2* = 

QLD etc.), and retrieve configuration information from the registry located on each machine. 

Finally, the Server Applications Services sub-system invokes a Business Process (BP) for a 
given BP message. 

1 5 Logical Components 

The Server Application Services sub-system includes Common Servers, Data-Access Module, 
Business Process, and the Business Process Access Module. Definitions of each component are 
given in below. 



20 Component Descriptions 

Definitions 

— Common ^pryj^c Common services to support the developme 

include decoding codes tables, retrieving configuration information from the registry, message 
handling, and the support for logging and handling server application errors. 



25 



Data Acce^ Motflulc. A data access module (DAM) provides access to data within the 
application database, A DAM performs specific data access such as Insert, Delete, Update, 
Select, Select All across one or more tables. It is an MFC Extension DLL encapsulating a 
Recordset object which uses ODBC to access the underlying DBMS. The DAM definition 
30 outlines how these modules are used and coded. 
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Business Process. A business process (BP) is the application or architecture functionality that 
may be invoked by the Business Process Access Module architecture. A BP is identified by a 
message type. A BP accepts a request message defined by the BP and may provide a response 
5 message for synchronous messages. Database access i$ provided to the BP by DAMS. A BP is 
an MFC extension DLL with a defined entry point 

Business Process Acc ess Module . This component is detailed in the communications sub- 
system. The Business Process'Access Module (BPAM) is the'architecture component that 
10 provides access to business processes. The BPAM invokes a BP for a given message type. The 

BPAM accesses the message address table to lookup BP module details. This component is 
detailed in the communications sub-system. 

Wireless Electronic Valet in Accordance With A Preferred Embodiment 

15 One cmbodiritcnt of the present invention is an a MobiJe Porta! Platform including a Mobile 
Portal and an Electronic ValcL. The electronic Vnlcl is a hand held wireless computer device 
executing Thin Client Software. Integrated into the Electronic Valet are various sensors, such as 
GPS, Bio-scnsors, and Environ-sensors. In addition, recording equipment, such as a camera and 
auido recorder, is also integrated into the Electronic Valet. The Mobile Portal includes a Mobile 

20 Portal Server which is connected to various third party content and service providers through the 
Inicmci or a Mobile Portal Extranet. 

Figure 26 is a flow chart illustrating how the hardware and software of one embodiment of the 

present inve ntion operates. An Electronic Valet 2602 revives input Hata frnrn gon^r.^ GPS,. 

25 camera, microphones, and other user inputs 2600 integrated with the wireless hand held device. 
The Thin Client application executing on Electronic Valet 2602, as discussed in detail below, 
allows the Electronic Valet 2602 to execute many different software applications without the 
need for a large amount of internal memory and storage capacity. The Electronic Valet 2602 
forms a message based on the data received and the user input. The Electronic Valet 2602 then 
30 transmits the message via antennae 2604 to the Mobile Portal 2606. The Mobile Portal 2606 

parses the message received from the Electronic Valet 2602 and forms a new message based on 
the message received. The Mobile Portal 2606 then determines the appropriate third party 
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service provider 2608 to transmit the new message to t based on the content of the message 
received from wireless hand held device 2602, and then transmits the new message. The third 
party service provider then performs the appropriate service and transmits the result back to the 
Mobile Porta] 2606. The Mobile Portal then forms a message based on the data received from 
the third party service provider 2608 and transmits the message back to the Electronic Valet 
2602. The Electronic Valet 2602 then formats and displays the data received. The Electronic 
Valet 2602 utilizes a wireless modem such as a Ricochet SE Wireless Modem from Metricom, 

Of course, wireless performance isn't nearly as reliable as a traditional dial-up phone connection. 
We were able to get strong connections in several San Francisco locations us long as wc stayed 
near the windows. But inside CNEPs all-brick headquarters, the Ricochet couldn't connect at all. 
When you do get online, performance of up to 28.8 kbps is available with graceful degradation to 
slower speeds. But even the slower speeds didn't disappoint. Compared to the altemativc- 
connecting via a cellular modem-the Ricochet is much faster, more reliable, and less expensive 
to use. Naturally, the SE Wireless is battery powered. The modem has continuous baticry life of 
up to 12 hours. 

Thus, utilizing the wireless modem, a user may utilize the Mobile Portal 2606 via the Electronic 
Valet 2602. Using appropriate key(s), the user may select a service to use in conceit with 
appropriate data obtained from sensors, GPS, camera, microphones, and other user inputs 2600. 
In certain circumstances, data may be automatically sent to select services based on the type and 
value of the data obtained by the Electronic Valet 2602. For example, when an integrated bio- 
sensor obtains certain predefined data values, an appropriate emergency care provider would be 
automatically contacted. In addition, the data obtained from sensors, GPS, camera, microphones, 



^rrd" utherliser inputs zouu, may also be'eombined before^emg sentTo an appropriate service 
provider. For example, in the example above, GPS position data may be sent with the bio sensor 
data to the emergency care provider. The emergency care provider would then know the 
patient's biological data and the location of the patient. Appropriate service could then be 
provided. 



Mobile Portal Platform 

The Mobile Portal Platform is a high-impact, server-based application in accordance with a 
preferred embodiment that is focused on the theme of delivering services and providing a 
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personalized experience for each customer via a personal site located on a server. The services 
are intuitively organized around satisfying customer intentions - fundamental life needs or 
objectives that require extensive planning decisions, and coordination across several dimensions, 
such as financial planning, healthcare, personal and professional development, family life, and 
5 other concerns. Each member owns and maintains his own profile* enabling him to create and 
browse content in the system targeted specifically at him. From the time a demand for services 
is entered, intelligent agents are utilized to conduct research, execute transactions and provide 
advice. By using advanced profiling and filtering, the intelligent agents Jeam about the user, 
improving the services they deliver- 

10 

A preferred embodiment of a system utilises a Windows CE PDA equipped with a GPS receiver, 
The embodiment is configured for a mall containing a plurality of stores. The system utilizes a 
GPS receiver to determine the user's location. One advantage of the system is that it enables the 
retrieval of data for nearby stores without relying on the presence of any special equipment at the 

15 mall itself. Although the accuracy of smaller, inexpensive receivers is limited to approximately 
75-100 feeu this has thus far proven to be all that is necessary to identify accurately the 
immediately surrounding stores. The system uses generated data rather than actual store ads and 
prices. Well structured online catalogs are used. Other embodiments utilize agents that "learn to 
shop" at a given store using a relatively small amount of knowledge. Moreover, as retailers 

20 begin to use standard packages to create online catalogs, we can expect the number of differing 
formats to decrease, resulting in a tractable number of competing formats. As electronic 
commerce progresses, it is not unreasonable to expect standards to evolve governing how 
merchandise offerings arc represented. 



25 Goal Specification 

Before leaving on a shopping trip, a shopper creates a shopping list of items by selecting from a 
preexisting set of approximately 85 product categories (e.g. men's casual pants, women's formal 
shocs l flowers, etc,). They also indicate the shopping venue they intend to visit from a list of 
malls, 

30 

Initial Store Selection 

Upon arriving at the mall, begins by suggesting the closest store that sells at least one item of a 

type entered by the user during goal specification. Along with the store name a system in 
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accordance wilh a preferred embodiment prepares a list of Ihe specific items available and their 
prices. A map of the mall displays both the precise location of the store and the shopper's 
current location. The shopper queries the system to suggest a store at any time based on their 
current location. 

5 

Browsing 

To address the need of many shoppers to visit malls or shop generally without a particular 
destination in mind. Figure 27A illustrates a display in accordance with a preferred embodiment 
of the invention. The display operates in a browse mode for use by shoppers as they stroll 

10 through the mall. In browse mode the system suggests items of interest for sale in the stores 
currently closest to the shopper. An item is considered to be of interest if it matches the 
categories entered in the goals screen. If there are no items of interest, the general type of 
merchandise sold at that store is displayed, rather than specific items. As the shopper strolls a 
map displays his or her precise current location in the mail. If an item displayed is selected by the 

15 shopper while browsing, the system alerts the shopper to the local retailer offering the same 

product for the lowest price, or announces the best local price. This search is restricted to the 
local mall, as that is the assumed radius the shopper is willing to travel. 



Alternatives 

20 It is worth emphasizing that the current inventive agent will support broader aspects of the 

shopping task, for example, it could operate as bi-directional channels. That is, not only can they 
provide information to the shopper, but* at the shopper's discretion, they may provide 
information to retailers as well. In this embodiment, the system indicates a shopper's goals and 
preferences to a retailer-based agent, who, in turn, responds with a customized offer that bundles 

25 service along with the product. Enabling the customization of offers is crucial to gaining the 
cooperation of retailers who arc reluctant to compete solely on price and of value to customers 
who base their purchases on criteria other than price. While the preferred embodiment focuses on 
location-based filtering primarily in the context of the shopping task, the current invention 
provides the basis for physical task support" agents that provide an information channel to 

30 people engaged in various tasks in the physical world. 
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The Predictive Value of Location 

The present invention is a significant advance over non location based agents because a users 
physical location is often very predictive of his or hers current task* If we know someone is at a 
bowling alley or a post office we can reasonably infer their current activity. Knowledge of a 
5 user's current task largely determines the type of information they arc likely to find useful. 

People are unlikely to concern themselves with postal rates while bowling, or optimal bowling 
ball weight while buying stamps. In addition, knowledge of the resources and obstacles present 
at a particular location suggest the range of possible and likely actions of someone at that 
location. This awareness of a user's possible and likely actions can be used to further constrain 
10 the type of information a user is likely to find useful. For example, knowledge of a restaurant's 
wine list could be used by a recommended system to constrain the wine advice it presents. 

Knowledge of a shopper's precise location in a shopping mall is valuable because it enables the 
identification of the stores immediately surrounding the shopper. The offerings of the stores 

15 closest to the shopper represent Ihe immediate choices available to the shopper. Given that 
shoppers place a premium on examining merchandise first hand and that mere is a cost 
associated with walking lo other stores, the merchandise of the closest surrounding stores 
constitute the most likely immediate selections of the shopper. Consequently, among the most 
useful information provided at any given lime is the availability of merchandise in the 

20 surrounding stores that matches their previously stated goals. 

People lend to move to different locations while performing many of their our tasks. This 

suggests that their immediate surroundings do not completely capture the full range of options 

they m ay have. In fact on e of the main reasons for leaving a location is to p erform an action that 

25 is not possible at the current location. Nevertheless, one docs tend to address most tasks within 

relatively local areas. Thus while their immediate surroundings suggest the options they have 

available at a given point in time t a broader view of a location will often capture the options they 

are likely to consider over the course of a task. In the case of mall shopping, for example, the 

stores immediately surrounding the shopper represent the options available at that moment. Mall 

30 shoppers, however, are generally willing to travel to any store within the mall. Therefore the 

potential options over the entire shopping trip include all the stores in the mall. Accordingly, 

information is presented on offerings of interest only from the immediately surrounding stores 

because these are the immediately available options. When asked for alternatives, the system 
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restricts itself to all the stores within the mall — the area within which the shopping task as a 
whole is likely to be performed. Being alerted that a store hundreds or thousands of miles away 
sells the same merchandise for a few dollars less than the cheapest local alternative is of little 
value in cases when shoppers require a first hand examination of the merchandise in question or 
5 arc not willing to wait for shipping. 



PHYSICAL VS. ONLINE SHOPPING 

In addition to the significant advantages over non-location based agents the present invention 
over comes disadvantages o online (or web) shopping. It is tempting to argue that online 

10 shopping will soon become the predominant mode of shopping, pending only greater penetration 
of home computers, the expansion of online offerings, and better online shopping tools. At first 
glance it would therefore appear to be a mistake to begin using location to support an activity 
that will become virtualized. Already we've seen the emergence of a number of software agents 
that support online shopping. For example, programs that allow users to identify the cheapest 

1 5 source for a music CD, given a title Similar programs have been developed for buying hooks, 
such as BargainBot. These systems demonstrate the potential of electronic commerce web 
agents lo crculc perfect markets for certain products. The success of these a^cnls will encourage 
the development of similar web shopping agents for a greater variety of goods. 

20 The Limitations of Online Shopping 

Certainly online shopping will continue to grow and the trend towards more powerful online 
shopping agents will continue. Nevertheless, it also seems clear that no matter how sophisticated 
web-agents become, traditional physical shopping will continue to dominate the market for the 
foreseeab le fu ture. Severa l inherent diffi culties of onlin e shopp in g will e nsure the continued— 
25 reliance on physical shopping: 

Non-fungible goods 

Web-based shopping agents have typically enabled users to identify the cheapest price for 
fungible products such as books and music CDs. While this capacity to create "perfect markets" 
30 for such commodities is of great benefit to consumers, several difficulties exist that will 
complicate applying these approaches to arbitrary products. 
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Commodities are particularly well suited to shopping agents because h is easy 10 make 
comparisons between competing offers* Because commodities are fungible, one of the very few 
dimensions upon which they differ is price- Price therefore becomes the primary* if not sole, 
criterion upon which purchasing decisions are made. 

5 

As soon as we move beyond commodities, however, several other criteria become important. 
For example, how do we compare items such as sweaters, mattresses, or tables? In addition to 
price we care about the materials used, the color, how it fits and feels, and the workmanship. 
Similar problems apply to most other products. 

10 

Imprecise goal specification 

A second, related difficulty lies in communicating our desires to an agent. Shopping agents arc 
great if the user knows the precise commodity he or she wants. Then they can simply enter the 
product by name. Unfortunately, if they don't have a specific item in mind when they shop, then 
15 the problem of conveying what is wanted to an agent becomes more difficult. For example, how 
does the user tell an agent what kind of lamp they want for their living room? 

Undeveloped preferen ces 

Interfaces that allow shoppers to include descriptive features like price ranges, color, options, 
20 brands, etc, can help address the above problem, but they are not enough. Much of the time 
shoppers cither haven't formed preferences or can't articulate their desires until afler they've 
started shopping and had a chance to examine various examples of the target products. 

Shoppin g is enterta inmeul ~- 

25 People like to shop and do so without having a specific purchase in mind. One study found that 
42% of consumers are "non-destination shoppers" that visit the mall primarily for leisure 
browsing and socializing. 



Shopping is sensory 

30 Even if the user could effectively provide these details most would be unlikely to delegate a 

purchasing decision to such an agent. After all, many people are uncomfortable even trusting 

spouses to make appropriate purchases on their behalf. Most people want to see and touch first 

hand what they're considering before making a purchase decision. The few preferences they 
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may provide an agent cannot replace this rich, first-hand experience. At best such preferences 
could be used to generate a candidate set for shoppers to consider. 

Instant Gratification 

5 Shopping is often a very emotional activity. People are pleased with their purchases and often 
can't wait to get home to try them out. The inherent delay between online purchases and their 
receipt is a significant issue to those who simply must take home their selections as soon as they 
sec them. 

10 In the end, consumers will continue to engage in physical shopping because of the limitations 
listed above. However, lhc fact that the task can't completely be delegated to software agents 
does not rule out a role for them. First, users find them useful for purchasing commodities when 
they know what they want, A second role, however, is to support the physical shopping task 
itself, throughout the time that a person is engaged in it. This, of course, is the approach taken in 

15 the Shopper's Eye project. 

Shopper's Eye 

At first blush it may seem that the current invention is subject to some of the same limitations as 
purely web-based agents. After all, why should it be any easier to communicate your goals to a 
20 PDA titan it is to a web-based agent? Why would your preferences be any more developed for 
purchases supported by a PDA system than a web-based agent? 

A key difference between purely web-based agents and the current "physical task support 
agents" (Le. an agent t hat suppor ts a user engaged in a task in a physi cal setting) is that web- 

25 based agents are completely responsible for conveying all information that will be considered by 
the user. On the other hand, "physical task support" agents in accordance with a preferred 
embodiment can augment the approaches of web-based agents by referring to aspects of a user's 
environment. For example, it is not terribly important to convey richly the feeling of a particular 
sweater if the sweater is in a store thirty feet away. It need only refer the shopper to the sweater. 

30 The shopper will gain a much better appreciation of the sweater by trying it on than through 

anything thai can be conveyed by the system. When loo many products match an imprecisely 

specified goal for a web-based agent, a more restrictive search must be made. However, many 

matches simply indicates there is a store that is likely to be of great interest to the shopper and 
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therefore should be visited, Once inside, narrowing down the merchandise of interest in person 
will often be far easier than refining the goals on a web-based agent. Therefore physical task 
support agents can assist users to elaborate their preferences and identify specific goals by calling 
users' attention to aspects of their physical environment as a means of conveying information 
5 throughout llic entire course of the task. 

The Promise of Physical Shopping Agents 

It is hardly surprising that physical shopping has been neglected by the agents community. After 
all, until very' recently there simply was no reliable way to deliver customized information to 

10 individual shoppers in remote locations. However, the explosive growth of PDAs, and their 

increasingly sophisticated communications capabilities promise to make them effective channels 
of "just in time" information to users wherever they happen to be. The present invention provides 
an imitive, novel agent that supports physical shopping by exploiting the promise of this 
developing channel that support all phases of the shopping task and solves the foregoing 

15 problems including: 

Specification of goals 

Shoppers begin by indicating at least the general category of merchandise they are interested in. 
Shopping agents need to enable the specification of goals at various degrees of specificity. With 
20 the present invention these goals may be refined as the task progresses. 

Exploration of Product Space 

Before shoppers can make a selection, they need to become educated about what is available. 

Sh opping age nts can aid in th is task by p res enting vario us classes nf offerin gs, reviews , . . 

25 demonstrations, etc. The present inventive Physical shopping agent can augment this by 
providing shoppers with a tour of the locally available offerings. 

Refinement of preferences 

As shoppers learn what is available and examine the offerings their preferences evolve. Agents 
30 need to enable shoppers to refine their preferences over lime. The present invention allows the 
user to refine their preferences. 

identification and comparison of candidate products 
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As shoppers begin to understand what they want and what is available they typically compile a 
list of candidates that will be considered more carefully. The present inventive agents supports 
the construction and maintenance of such lists and facilitates the comparison of candidates within 
the list according to various criteria. 

5 

Negotiation of offers 

The present shopping agent is not restricted to providing the shopper with information* It is 
possible to negotiate prices and service options with retailers. 



1 0 Product Selection, Purchase and Product support 

The present invention facilitates the transaction itself and can be used as a channel through 
which product service can be delivered. 

Figure 27B is an illustration of the Mobile Portal platform 2710 including a Mobile Portal 2712 
15 and an Electronic Valet 2713. The Electronic Valet 271 3 includes a supporting hardware device 

2716, such as a wireless PDA, and a Mobile Portal Thin Client standard 2714 executing on top 
of a Thin Client Operating System 2718. The Mobile Portal consist of an encryption and . 
decryption element 2720, a Mobile Portal Server 2722, intelligent agents 2724, a Customer 
intelligence element 2726, and a Customer database 2728. 

20 

Thin Client is a generic term used to describe a group of rapidly emerging technologies that 

provide a reduction in total cost of ownership through a combination of reduced hardware costs, 

reduced maintenance and support costs, reduced LAN/WAN bandwidth requirements, reduced 

down time, impr oved performance an d enhanced secur ity. The term 'Thin" in T hin Client refers 

25 to the (very small) size of the client operating system. In contrast, traditional PC operating 

systems (DOS, Windows 95, etc.) are considered "Fat" Clients due to their large size and 

resource requirements. Despite the fact that the Thin Client operating systems arc thin, the 

capabilities of Thin Clients are robust. Thin Client solutions are deployed today in mission 

critical environments and they are providing reliable and responsive access to a myriad of 

30 applications. The Mobile Portal Thin Client 2714 is a Thin ClicnL wherein the majority of the 

processing is done on the Mobile Portal Server 2722 and related third party content and service 

providers 2730. The user utilizes the Mobile Portal Thin Client application 2714 to select 

services and review information provided by the Mobile Portal Platform 2710. The Mobile 

100 



PAGE 138/181 * RCVD AT 1/14/2005 12:09:56 PM [Eastern Standard Time] ' SVR:USPTO€FXRM/28 * DNIS:2?34041 * CSID:8013281707* DURATION (mm-ss):68-28 



01/14/2005 1 1:05 FAX 8013281707 WORKMAN NVDEG6ER (2)139/181 

WO 00/54206 PCT/IB00/00385 *" 

* 

Portal Thin Client application 2714 is made more device independent by the use of a Thin Client 
Operating System 2718. The Thin Client Operating System 2718 acts as a messenger between 
the Mobile Portal Thin Client application 2714 and the supporting hardware 27 J 6. The Thin 
Client Operating System 2718 allows the Mobile Portal Thin Client 2714 to make function calls 
5 to the Thin Client Operating System 2718 for low level hardware operations, such as display 

calls and user input queries. A separate Thin Client Operating system 2718 can be developed for 
each hardware device 2716 used as the supporting hardware for the Electronic Valet 2713. This 
allows the Mobile Portal Thin Client application 2714 to run on different supporting hardware 
27 J 6 without the need for significant low level design modification. 

10 

The Mobile Portal 2712 receives data from the Electronic Valet 2713 via a packet-switched 
wireless network 2732- Information received through the packet-switched wireless network is 
tlicn decoded by the encryption and decryption clement 2720 of the Mobile Portal 2712. Once 
the data has been decoded the Mobile Portal server 2722 utilizes intelligent agents 2724, 

15 customer intelligence 2726, and customer data 2728 to obtain the requested data from third party 
content and service providers 2730. The Mobile Portal Server 2722 utilizes intelligent software 
agents to respond to customer needs. The software agents 2722 utilize customer data 2728 to 
determine to personalize their task to the individual user's goals, habits and preferences. The 
customer data 2728 is in turn routinely updated by the customer and by the customer's actions. 

20 Each time a user uses the Mobile Portal 2712 a log is kept of the user's queries and other uses of 
the Mobile Portal Platform 2710, In this way, the software agents 2724 are able to utilize the 
user's past habits to personalize their task. 



I n a ddition to s oftw are-agents 2724, th e Mobile Portal Server 2722 utilizes c u stomer intelligence 

25 2726 to respond to user needs. The user may utilize data-mining and pattern recognition to find 
the information he desires. Again, the customer data 2728 is updated to reflect the users data- 
mining and pattern recognition uses. Third party content and service providers 2730 are utilized 
by the Mobile Portal 271 2 to provide the services and information requested by the users. The 
third party content and service providers may be accessed through the Internet or through a 
30 Mobile Portal Extranet. The intelligent agent software 2712 search through the third party 

providers to determine the one most suitable for the user, taking into consideration the 
customer's profile contained in the customer data 2728. In this way, the user may be less 

specific in their queries than they would have to be without a user profile. For example, a user 
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can request a jacket utilizing.thc Mobile Portal Platform 2710. The intelligent agents would then 
utilize the customer data 2728 to determine more specifically what the customer actually desired 
In this case, the customer data 2728 may information that this particular user likes denim jackets 
as opposed to leather jackets. The intelligent agents 2724 would then search for denim jackets. 
5 Of course the user profile could be overridden by the user in order to obtain information that is 
contrary to what is stored in the user's profile. Some typical services provided include 
geographic location information, audio and visual editing, personal news & entertainment, 
personal shopping, personal health & safety, personal organizer, personal finance, and personal 
communication. 

10 

Geographic location services are typically based on information received from the integrated 
Global Positioning System. GPS dala is combined with specific user request data to provide 
location specific information to the user. For example, the user may be located in San Francisco 
and wish obtain information on fine dining in the city. The user would request fine dining 

15 information utilizing the Electronic Valet 2713. Location data obtained from the integrated GPS 

receiver would be automatically combined with the user request for fine dining, and the 
combined message would then be transmitted to the Mobile Portal 2712. Based on the data 
received, the Mobile Portal would select the appropriate service and transmit the request, in this 
case fine dining in San Francisco. The Mobile Portal would then transmit the response received 

20 back to the Electronic Valet 2713. The user is then presented with the requested information, 
formatted and displayed on the display device of the Electronic Valet 2713. 

Audio and visual editing services are typically based on the data received from the integrated 
camera and micr op hone. The user typically captu res images utilizing the integrated dig ital 

25 camera. However, the user may also obtain digital images from other sources, such as scanners, 
e-mail, and web pages. In addition, the user typically captures sound files utilizing the integrated 
microphone. However, audio files may also be obtained from other sources, such as e-mail, web 
pages, and CDs. The image and/or audio data is combined with specific user request data to 
provide image and audio editing capabilities to the user. For example, the user may capture an 

30 image with the integrated digital camera, and then request to edit the image using a specific 

photo editor. The image captured by the integrated digital camera is then combined with the 

user's request for photo editing, and the combined message is then transmitted to the Mobile 

Portal 2712, Based on the data received, the Mobile Portal 2712 selects the appropriate service 
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and transmits the request, in this case image editing. The Mobile Portal then transmits the 
response received back to the Electronic Valet 2713. The user is then presented with the 
requested infonnation, formatted and displayed on the display device of the Electronic Valet 
2713. In this case, the user would receive a user interface for image editing. The user would 
then use the image editing user interface to edit the image. Changes to the image are treated as 
request which the Mobile Portal 2712 passes on to the image editing application, running locally 
or on a separate server. 

Supporting Code in Accordance With A Preferred Embodiment 
The following code is written and executed in the Microsoft Active Server Pages environment in 
accordance with a preferred embodiment. It consists primarily of Microsoft Jscripl with some 
database calls embedded in the code to query and store information in the database. 

Intention-Centric Interface 

Create an intention ASP Page C?intcntion_create.asp*') 

<%6 LANGUAGE * "JScript* \> 
<\ 

fteAponBe. Buffer = true; 
Response. Expires * 0/ 
S> 

<head* 

<ticlft;»Create An intent ion*:/ tit le> 

</bcad? 

«body bgcolor=-flFFE9rjS- style. "f ont- family : Arial" text«»B0OE>ooo*> 



_ f 

//Define some variables 



upl = Servar.CreacAObject I "Soft Artisans. FileUp- ) 
intent ionname - upl . Form ( "intent ion_name*) 
intent ion desc » upl .Form < " intent ion_desc« ) 

//intent ion_name - RequeBt , Fom ( M lot Bntion_name k ) 
//intencicm_desc = Request . Form ( ■ intcntion_deac p ) 

//intent ionicon -» Request .Form I "intent ion_ icon" ) 
submitted = upl . Farm ( "submitted" ) 
items = new Enumerator <upl . Form) 

40 *> 
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//Establish connection to the database 

objConnection » Server. C7eate0bject<»ADQDB. Connection") 
obj Connection . Open ( "Maelstrom" ) 



10 



<% 



//Check to see if the person hit the button and do the appropriate thing 

if (submitted -Add/Delete") 

( 



Zl*9 



'false* 



15 



//loop through All the inputs 
while ( J items .atfcnd<) ) 

i * items . item () 



20 



25 



30 



//if iteniB are chocked then delete them 

if (upl .Form (il == -on" ) 

( 

obj Connect ion. Execute (-delete £?ocn user_ifttontion where intent ion_id - 

oh jCOtmect ion. Execute ("deleCO from intentions where intent±on_id = " + i) ; 
objConnection. Execute-delete frCm toolset contention where intenfcion_id 

flag = "true" 

J 

itens . noveNext ( ) 



) 



35 



40 



// if lt«m 8 were not deleted then insert whatever is in the text field in the database 

if (flag "false-) 

I 

int ent i an_nMM_6hort - int ent ion_name . replace < J /gi , » ■ > 
ob j Connect ion. Execute ("INSERT into intentions 



(intention_name,int«ntion_desc,intention_icon) valueaf" + i«tentioa_nawie + " • ■ " ♦ 
intention_denc + ». f .» «> intent ion_nara«_ahort + ".gif ♦ "'I*) 

Response. write ("the intention short name is - + intent ion_name_6hort J ; 

upl . SaveAa ( " E t developmenc /aspexamples / - + Int ent ion_naffle_ahort -* ■ . g i f - ) 



45 



// Query the database to show the moat recent itexrts. 

rsCuBtonerBl.i9t = obj Connection. Execute ("SBlJSCT - FROM intentions*) 

%> 

< input Cype=- Submit" name ret urn^to^mcp" value* "Go to Main Control Panel" 
oncl icko- location. href -'default .aap' "> 

<£orm oethod=-post M act ion=« intent ien_create .-asp* enctype=«multipart/f onn-data" > 
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ctrxtd colapan^-a-.^font f ace- "Aria* • siae^M-xb^Enter in a new intenfcioa«/bx/f oucWedx/t 

<trxtd><fnnc f a Cg=« Axial "> Name i</f ont>-e/td* <td>*XHPOT TYtE-" text ° 
name- * intent ion_name ■ >< /td> c r * 

<trxtd>€font face-»Arial»>Oe3Clfiptioiii</font></td><td><TBXTivRKA 
tlalfte= inteQtion_deac» *^/TEXTA£UEA>c/td>< /tr > 

<trxtdxfonc fa«^»Arial->Icoo Troase :</f Qnt></td><td»«iNPOT TYPE«"£ile* NAME- - in t exit ion_ic©n " 
aize=4 0></tdx/cr> 

<tr>^td colaf>an="2"><iMPur type- -submit" name- -auboiitted- value- "Add/Delete* ></td>«:/tr> 

<font faee=-AriaX- ei*6=-+l«>*b ^Current tntentionB*/b></£ont> 

15 <tr bgcolor-Efig78C *lign=-center"> 

<td> 

<FONT coloro-wtaice">Delete«/FOIIT> 



10 



20 



30 



35 



40 



45 



c/td> 
<TD> 

</TD> 
«TD> 



*/TD> 

25 <TDa. 

*/TD> 
</tr> 



<FONT cOlor="white n >IC*ntion*/FONT> 
■cFOHT colore "white N >DGScriptiott</FONT> 
<FQNT color="white< , >Image<c/FC»rr> 



// I*©*p over the intentions in the lioc 
Counter » 0; 

while ( IraCustomeraList - EOF) 
( 



*tr bgcolor^* wh ite- atylc - " Font - aire - **»ller" 
<td align=erenter> 



*/TD> 
*td> 

</td> 
<td> 

</td> 
<cd> 

</td* 

</tr> 



< INPUT cype- 'checkbox- rvarie-" <*=r-aOiacomeraiiist ( ^ intent ion id" ) 

x-sCuatocaeraList ( -intent ion_name") *> 

rsCuatoineraLiat ( •*intention_daec" ) %> 
<img arc-" . ,/inage»/<»r raCuacome* oLiat (-intention^ieon-) 
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10 



counter* ♦ 

recuetonerabiftt .HovcNaxt (> } 
%> 

< /TABLE* 

<br> 

Available Toola 
</form> 

</BODY> 
«t/HTHL> 



15 



20 



Retrieve Intentions List ASP Page ("intentions Jist.asp") 

I-- include <tlG = - inclw<Sc/check_auchentlcation.iac- 



<HTML> 
<H£AD» 



<TXTLE>mySiLel ZnCenciona fcist</TrTLE> 



<SCRI PT IANGUAOE= "JavaScript - * 

function intent ionoLiat (> ( 



thie -internalArray = new Array (), 



25 



30 



35 



40 



// establish connection to the database 

obj Connect ion . Server .CreateQbject ("AOODB. Connect ion*) ; 
ob jConnecc ion. Open ( ^Maelatrofn") 

// create query 

intentionsQuery = obj connection .Execute ( "SELECT » prom intentions order BY 
intent ion_namc aae 1 ); 
S> 

// write ouc the options 

<« 

whi lft ( l intent ionaQuery . EOF) { 

intent ionName B intent ioxteOuery ( " intent ion_na^le ,, ) ; 
intentionxoon = incentionsQuety { "intent ion_ieon- ) ; 



45 



this . internal Array nuraOptlona«>) - new Array (2); 
thig.lnt6rnalAcr«yl<*= numOption«%>| CO] = M <*= incentioxiNamte *>" ; 
this.inte«valArray [<%* numOptlona**! fl J - -images/^%- intentionlcon %>- 
numOptions**; intent ionsQuery .move^ext (> ; %> 
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numzntentiona «. <« B numOptiona%>; 

intentionArray ■ new intent iOnaLiet {). int^rnalAr ray j 
function aelectXutentipn () { 

for (i=Q;i<nuioIuteiitiona;i+-») ( 

if ( lncentionsi*iot select. opciona I i] .eeiected> ( 

int<tntionNameTe*tFieid, value - intent ionAr ray [ij [Oj ; 
//intent ionPiceure. flrc = intcntionArray f i] Ul % 
break ; 

) 



10 J 

) 

</SCRIPT> 
«/KEAD> 



*BODV flCC0L0R«"- I %-Sea S l O n(-main_backSircSund-}%>- «tyl e «-£ont-f Ataily i Acial«> 



< t *FORM NAWB^-intention^liBt-* 

20 STABLE FftAME— "BOX* Jj©rder=0 CBLLPADDIH0--2" CELfcSPACItJG=-2«> 

«TR»<TD COI^PArt=»3- 6TYI*E="f ont : 20pt arial" ALlGN« "CENTER " xfi >Add * W ySitel 
Ir.tcntion</Bx/TD></TR> 

25 *TKxT0 COLSPANf-3 »>tnbsp;</tDx/TR> 

<TD width*-10o-><tCAt aixe---l->Pl e ag e select An Intention You would Like to Add to Your 
Lisc</£ontx/TD> 

30 

<SELECT *D«"lntentianaLi*tS«lect»- NAME- • Intent ionsLiat Select- SIZB--10" 
atyle--font: 9pc Arial;' onCliek^-Belecc intention O ■» 

intent ionsQuftxy.inaveFirsc (} ,• 
£or t j-0; i<numpptiona; [ %> 

OPTION VA1UE* »<1= in tent io ngQu«ry<" intent ion id-) %>" <% if M „ Q) f %> 

SELECTEP <t ) %>> 

<%■> intentiona Query (" intent ion_name ,> > 
<* intentionaQ^ery.novBtlejLt {) 

40 | 

intentioneOueicy,ttavfiFi.rBtO ; 
< /select > 

45 </td> 

</TfL> 

■cTRxTO COLSPAN- n 3">&nbap;</TDx/TR> 
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<TR> 

<TD WidtJi«»100"xfont p±2«-"-l«>CuatOttiBO the Intention hamb</£oiiC >*/!!>> 
<TD COLSPAN-2"xlKPUT TYPE- "text* NAME=" intent ionMameTextPielil rt 
5 ID- « int ant i^ameText Field ' SI2E»^0- VALUED <*- iiitanti^aQuery ( - ineentlon^arae ■ ) %>">-c/TD* 

c/TR» 

<TR**TD CQL9PAN="3">L^toDp;</TDx/TR> 



10 



15 



<TR> 

<TD COLS PAN-" 3 " ALIGN-" CENTER "> 

<ItfPUT TYPE-«button- MAME-«intentionOKButton ta VALUED ** OK " SIZB--10- 

lD=-intentionOX&itton* bilClickr-iavaScripCTtcp.tipenetf . top.navf rarao.addAnj^ccQtionO "> 



*nb*P ; tnbap ; finba? ; tnbep - &nb«p ; inbap , in* op ; &nbe P ; fcnbap , tnhop ; «,nbep ; Lnbap; uibap; fcnbap , 
< Input type- "but ton- KAME*-intentionCancelButton- vALUB«"Cancal" sizk-»io- 
ID=" intent ionCancel But ton" onclick- "self . cloee () ;■> 
</Tl)> 

</TR> 
20 -e /TABLE* 

<! </FORM> > 

< /CENTER> 

<l ob j Connect ion. cl ose () ; %> 

25 

</ttTMIi> 



30 



35~ 



Display User Intention List ASP Page (excerpted from "navigation-asp") 

<t>XV ID="intentionliet- style -"poa it ion s absolute; width^iO; h*igbt:95; left: afiSpt; cop: -5; 
viaibility: Hidden; font- faihily : Arial; font-color- 3000000; JEonc t Apt Arial ; - > 
<UTV atyle=-p©aition: absolute; top;7; left : 7. Hei 9 ht:7B; widthx310; = -ind*x : 2 r - background : 
<%=Seaaion(«main_bftclc g round")*>; border: aolld ipt #000000; padding: 3pt ; overflow; autO; alink: 
black; link.: black;"* 

*body LINK--HQ000OO- ALINK- ■ tl 000000" vl ink- "black ■» 



// crcftLa query 



intent ions Query = objCOtmact ion, Exe cute < •SELECT uaer_intencion* • FROM 
uoer_intention. uoerjntanc ion_£o_per*Ona WHERE u<ier_intentticm_to_perflona . UDer_pernonA_id - * 
40 Session C"curratUaerPersona-> + - AND uaar_intention_to_persona .ufler_incention_id = 

uaer_intcnt ion . uoer_intent ion^id " ) ; 

numinttsntiona = 0 ; 

Rcaponae .Write ("<SCfi IPT >num| n tent ions-" + int en t ion e Query .RecordCOune + 
■< /SCRIPT xTABLE ceUpadding= ■ D ■ widths ' 100% • cell 9 pacing* 1 Q > ) ; 



45 



while ( J intentionaQuery .BOP) 

i 
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<TRj^TO><* hrafn- javascript i change Intent lean < •*%- 
intentioriBQuery(-us«ir_ii,tention_idM »>•, ' «:%-nuikintentIaiiB%:>. » > * on«oufleover«"mous*OverTab<) « 
onmouserOut= n moUBGOutOZTab () »^<£cjnt color~*BlaC>c H £ace- u arial- 9i2a- n -2 •><%- 
inttntioneQuery (" intent i^ti_cuatoni_iMtm© p ) %></£ont ></&>< /tpj<td><img align-- right* 
ERCn'inagea/delefce.gif- aXt-'Dnlete thia intent ion** onClick=»CQnf inttDolete (c%* 
incancionsQy^ry (»u£ier_intention_ia-) %>) »></TD^</th> 

<; tnuml n tent ion b++; intent lonaQuery -maveN&xt < ) f - 

<* ) 

Re3ponae.Writer<£CRIPT5.uumihtentione=* , +numiiitejitionfl + h </SCRIPT> ,, ) ; 
%> 

<trxkd colspan* H 3"><hrx/td></tr> 

<TR»<td C6lBpaii=-2-»^ href--j«vaacript:Ch*ngreIntention('Add 
. , , ' , <*=nuTai.ntentiona%i} ; ■ onmou^pvev.'BiouaeOvemb () - onmouacout^raouseOutOfTab f ) ">^£ont 
15 color. "Black" £ace--«rial- Biat«o»-2">add . c/font tdx/TRo. 

</tahle> 

</body» 
«c/DIV> ' 

<DIV style- "position: absolute; tOp;0; left; -5 j width; 230; height: 10 5 i &- index:!; « 
20 onaiouaeout- ■ intentionli at .style. vieibility=r* hidden* * 

anmouaeouC:*= k ineetitioxiligt , style ^visibility-* ' Hidden ' ■ 
Oiunoua^over-- intent ionl ia t .style - visibility** ' hidden* " s.</t>IV> 

c/DIV> 

25 

While various embodiments have been described above, il should be understood that tliey have 
been presented by way of example only, and not limitation. Thus, the breadth and scope of a 
preferred embodiment should not be limited by any of the above described exemplary 
embodiments, but should be defined only in accordance with the following claims and their 
30 equivalents. 



109 



PAGE 147/181 * RCVD AT 1/14/2005 12:09:56 PM [Eastern Standard Time] » SVR:USPTO-EFXRF-1/28 ' DNIS:2734041 ' CSID:8013281707 ' DURATION (mm-ss):68-28 



01/14/2005 1 1:08 FAX 8013281707 WORKMAN NVDEGGER @] 148/181 

WO 00/54206 , FCT/IB0O/OO385 

CLAIMS " 

What is claimed is: 

1 . A method for obtaining health care on a mobile computing environment, comprising the 
steps of: 

5 (a) creating a query based in part on user input; 

(b) querying a network of information utilizing a wireless communication device; 

(c) receiving the response to the query from the network of information on the mobile 
computing environment; 

(d) monitoring health information pertinent to a user; 

10 (e) processing the health information and the response utilizing an application tool; and 
(0 displaying health information to a user, 



A method for obtaining health care on a mobile computing environment as recited in 
claim 1, wherein the heath information includes nutrition information. 

A method for obtaining health care on a mobile computing environment as recited in 
claim 1 > including the step of monitoring a user exercise program and providing a display 
of suggested exercises. 

A method for obtaining health care on a mobile computing environment as recited in 
claim 1, including the step of displaying self diagnosis information. 



5. A method for obtain ing health care on a mobile computing environment as recited in 

20 claim 1, including the step of displaying an emergency message and transmitting an 

emergency message. 

6. A method for obtaining health care on a mobile computing environment as recited in 
claim 1, including the step of coordinating health records with medical personnel, 

7, A method for obtaining health care on a mobile computing environment as recited in 
25 claim 1, including the step of coordinating insurance claims, 
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* 

8. A method for obtaining health care on a mobile computing environment as recited in 
claim 1 , including the step of displaying special condition information. 

\* 

9. A method for obtaining health care on a mobile computing environment as recited in 
claim 1, including the step of coordinating post treatment care for a user with a health 

5 care facility. 

10. An apparatus that provides health care information on a mobile computing environment, 
comprising; 

(a) a processor; 

(b) a memory that stores information under the control of the processor; 
10 (c) logic that creates a query based in part on a user input; 

(d) logic that queries a network of information utilizing a wireless communication device; 

(e) logic that monitors health information pertinent to a user, 

(f) logic that processes the health information and the response utilizing an application tool; 
and 

15 (g) logic that displays health information to a user. 
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1 1 - A computer program embodied on a computer-readable medium that provides health care 
information on a mobile computing environment, comprising: 

(a) a code segment that creates a query based in part on a user input: 

(b) a code segment that queries a network of information utilizing a wireless communication - 
5 device; 

(c) a code segment that receives the response to the query from the nctwoTk of information 
on the mobile computing environment; 

(d) a code segment that monitors health information pertinent to a user; 

(e) a code segment that processes the health information and the response utilizing an 
1 0 application tool; and 

(0 a code segment that displays health information to a user 

12. A computer program embodied on a computer-readable medium that provides health care 
information on a mobile computing environment as recited in claim 1 1, wherein the heath 
information includes nutrition information. 

15 13 - A computer program embodied on a computer-readable medium that provides health care 

information on a mobile computing environment as recited in claim 1 1, including a code 
segment that monitors a user exercise program and providing a display of suggested 
exercises. 

14. A computer program embodied on a computer-readable medium that provides health care 

2° information on a m obile computi ng environment as recited in claim 1 1, includin g a code _ 

segment that displays self diagnosis information. 
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1 5. A computer program embodied on a computer-readable medium that provides health care 
information on a mobile computing environment as recited in claim 11, including a code 
segment that displays an emergency message and transmitting an emergency message, 

1 6. A computer program embodied on a computer-readable medium that provides health care 
5 information on a mobile computing environment as recited in claim 1 1 , including a code 

segment that coordinates health records with medical personnel. 

1 7. A computer program embodied on a computer-readable medium that provides health care 
information on a mobile computing environment as recited in claim 11, including a code 
segment that coordinates insurance claims, 

10 IS. A computer program embodied on a computer-readable medium that provides health care 
information on a mobile computing environment as recited in claim 11, including a code " 
segment that displays special condition information. 

1 9. A computer program embodied on a computer-readable medium that provides health care 
information on a mobile computing environment as recited in claim 1 1 , including a code 
,5 segment thai coordinates post treatment care for u user with a health care facility. 
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PUBLIC SUB 
MAIN 

(STARTS PROGRAM) 
200 



PRIVATE SUB 
ProcessCommandLme 
(PARSE THE COMMAND 
LINE FOR MEETING TEXT) 
210 



PRIVATE FUNCTION 

CreateStopLisl 
(PREPARES GLOBAL 
STOP LIST) 
220 



PUBLIC SUB 
CreatePattems 

(PREPARES ALL THE 
PATTERNS FOR 

PATTERN MATCH) 230 



FIG. 2 

SUBSTITUTE SHEET (RULE 26) 



PUBLIC SUB 
GoBackgroundBnder 
(WRAPPER 
FUNCTION) 
240 



PUBLICFUNCTION 
ParseMeetingTest 
(EXTRACTS KEYWORDS 
ROM MEETING 
RECORD) 250 



PUBLICFUNCTION 
GoPattemMalch 
(INITIATES PATTERN 
MATCHING) 
260 



PUBLICFUNCTION 
SeardiAHaVista 
(PARSE RESULTS) 
270 



PUBLICFUNCTION 
SearchNewsPage 
(QUERY AND PARSE 
RESULTS) 
275 



PRIVATE FUNCTION 
ConstrudOveiallResul 
(PREPARES DATA) 



280 



PUBLIC SUB 
ConnedAndTFaiderToUunin 
(SENDS DATA TO MUNIN) 
290 



BUILT-IN FUNCTION 
Winsock.SendDala 
(SENDS DATA 
THROUGH UDP) 
295 



PU8UCSUB 
OisconnedfrcmMuninAni^ 
(ONCE DATA IS SENT, 
CLEAN PROGRAM AND 
EXIT) 297 
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PUBLIC SUB 
MAIN 
START 
300 

i — 



PUBLIC SUB 
GoBackpundFinder 
(WRAPPER FUNCTION) 
310 



x 



PUBLIC FUNCTION 



(EXTRACTS KEYWORDS) 
320 



PRIVATE FUNCTION 
FormalDelimitalion 
(MAKES SURE THAT 
DELIMITERS ARE PLACED 

CORRECTLY) 
L 330 


PUBLIC FUNCTION 
DelemiineNumWords 
(RETURN NUMBER OF 
WORDS IN STRING 
GIVEN SEPARATOR) 
340 


PUBLIC FUNCTION 
GelAWordFrontString 
(GET iTHFELD FROM 
INPUT MEETING TEXT) 
350 




PRIVATE FUNCTION 
FornialDelimMon 
(CHECK DELIMITERS) 
370 


PRIVATE FUNCTION 
FonnalDelimitafian 
(CHECK DELIMITERS) 
3B0 



PRIVATE FUNCTION 
ParseAndCleanPhrase 
(EXTRACTS A WORD 
ATATIME FROM 
TITLE AND BODY) 
360 



PRIVATE FUNCTION 
RndMm 

(FINDS THE NEXT 
CLOSEST WORD 
DELIMITER) 362 



PRIVATE FUNCTION 
deanWorti 
(STRIPS OUTUNWANTED 
CHAR/PUNCTUAHON) 

m 



PRIVATE FUNCTION 

EvahjateWoid 
(CHECKS TO SEE IF A 
WORD IS IN THE STOP 
LIST) 366 
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PUBLIC SUB 
MAIN 
400 
I 



PUBLIC SUB 
GoPattemMalch 
410 



x 



PUBLIC SUB 
MalchPattems 
420 



PRIVATE FUNCTION 
MalchAPattem 
430 



PRIVATE FUNCTION 


PRIVATE FUNCTION 


PRIVATE FUNCTION 


PRIVATE SUB 


PRIVATE SUB 


MatchMeetingfieH 


LocatePatemHead 


toratelndicalor 


IniliafeeGuessesRecord 


AddToMeetingRecord 


440 


450 


460 


470 


430 



H 



PRIVATE FUNCTION 
BindNames 
441 



PRIVATE FUNCTION 
GetNexfVVordAfterWhiteSpace 
452 



PRIVATE FUNCTION 
BindAFullName 
GeWextWordAterWrrteSpace 
442 



u 



PRIVATE FUNCTION 
GelNexlWordAfteiWhite Space 
462 



PRIVATE FUNCTION 
NoDuplicateEnby 
482 



PRIVATE FUNCTION 
ConlainlrtArray 
454 



PRIVATE FUNCTION 
ContainlnArray 
464 



PRIVATE FUNCTION 
HrjdTqne _ 
443 



1 



PRIVATE FUNCTION 
GetNexIWondAflerWhiteSpace 
444 



PRIVATE FUNCTION 
BindCompanyTopidoc 
445 



PRIVATE FUNCTION 
etNexfWordAfterWhileSpace 
446 
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PUBUCSUB 
MAIN 
500 



PUBUCSUB 
GoBadtgroundFinder 
(WRAPPER FUNCTION) 
510 

,.*: — . \ 



1 


PUBLIC FUNCTION 
SearchAJ&VisIa 
530 




PRIVATE FUNCTION 
ConstmctAltaVistaURL 
540 


PUBLIC FUNCTION 
IdenlifyBlock 
550 


... — i 

PUBLIC FUNCTION 
IsOpenURLError 
560 



PUBLIC FUNCTION 
SearchNewsPage 
520 



PRIVATE FUNCTION 
ConstructSimpleKeyWord 
542 



PRIVATE FUNCTION 
ConstmctComplexAVKeyWord 
544 



PRIVATE FUNCTION 
JomWilhConnectors 
545 



PRIVATE FUNCTION 
RelineWithRank 
546 





PRIVATE FUNCTION 




JoinWiEhCotmedors 




548 




PRIVATE FUNCTION 






RefineWUhOate 






549 





PRIVATE FUNCTION 
ConstiuctNewsPageURL 
521 • 



PRIVATE FUNCTION 
ConstnjdSimpleKeyWord 
522 



PRIVATE FUNCTION 
ConsliudComplexNPKeyWord 
524 



PRIVATE FUNCTION 
JoinWShCoruiBclors 
526 




PUBLIC FUNCTION 
IsOpenURLError 
528 
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610- 



COMMAND LINE 
"/ userjd, meeting title, meeting body, list, location, time" 



620- 



MESSAGE 

"userjd, mealing life, meeting body, participant list, time' 



630- 



MEETING RECORD TO STORE CURRENT MEETING INFORMATION 
stUSERiD, sTitleOrig, sTitleKW, sBodyKW, sLocation, sTune, 
sPartidpants{ ), sMeetingText: original message minus userjd 
sCompany, sPeople, sTopic, sWhen, sWhere from GoPattemMatch 



640- 



650- 



680- 



SUBMIT QUERY TO ALTAVISTA 



SUBMIT QUERY TO NEWSPAGE 



STORE MESSAGE IN QR esult Overa]! 
'msg_id, userjd, meeting title concatenated with stories" 



67(K 



PROCESS STORIES FROM ALTAVISTA AND NEWSPAGE 
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710- 



720- 



A MEETING RECORD-POTENTIAL COMPANIES, PEOPLE, TOPICS, 
LOCATION AND A TIME ARE IDENTIFIED 



AT LEAST ONE TOPIC IS IDENTIFIED 



730- 



AT LEAST ONE COMPANY NAME IS IDENTIFIED 



740- 



A DECISION IS MADE ON WHAT MATERIAL TO TRANSMIT 
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800 


A MEETING RECORD-POTENTIAL COMPANIES, PEOPLE, TOPICS, 
LOCATION AND A TIME ARE IDENTIFIED 








820 


AT LEAST ONE COMPANY NAME IS IDENTIFIED 








830-^ 


AT LEAST ONE TOPIC IS IDENTIFIED 









USE THE TOPIC AND OR THE COMPANY 



FIG. 8 
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900- 



910- 



BOOK OR OTHER PRODUCT WITH VISIBLE UPC BAR CODE 



MINIATURE BAR CODE READER 



920- 



IP WIRELESS PHONE OR OTHER HANO HELD DEVICE 



930- 



ANTENNAE TRANSMITS SIGNAL 



JGSOFTWARE 



950- 



960- 



PRODUCT LOOKUP ON THE WEB 



BUY PRODUCT ON THE WEB 
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( START ) 



1001 -x/USER REQUESTS^ 
yCQNTENT PAGE J 



1003 



1002- 



USER PROFILE 
DATABASE 



1004- 



1006- 



1007- 



GET 



USER 



PREFERENCES 



GET PAGE 
CONTENT 



GET USER- 
CENTRIC CONTENT 



CREATE PAGE 
USING LAYOUT 
PREFERENCES 



DISPLAY PAGE 
TO USER 



C END ^ 



1005 

_J_ 

CONTENT 
DATABASE 



FIG. 1 0B 
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1110- 



1*111 - 



1122- 



C START ) 



PARSE CONTENT 
FOR TIMES, DATES, 
CONTACTS 



GET USER- 
CENTRIC CONTENT 



1112- 



1115- 



1117- 



1119- 



.1121- 



GET MATCHING 
CALENDAR ITEMS 



GET MATCHING 
EMAIL ITEMS 



GET MATCHING 
CONTACT ITEMS 



GET MATCHING 
TASK LIST ITEMS 



GET MATCHING 
NEWS ITEMS 



RETURN 
CONTENT 
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DATABASE 
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